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ABSTRACT 

The 594 studies referenced in this volume, the first 
of a two-volume set, synthesize reading comprehension research 
conducted from 1974 to 1984. The 12 chapters cover the following 
topics: (1) the necessity for both quantitative and qualitative 
meta--analysis for a complete state-of-the-art understanding of any 
domain, (2) the background of the research project that generated 
this volume, (3) a quantitative meta-analysis of reading 
comprehension research, (4) research on reading comprehension 
instruction, (5) reading instruction with the special education 
student, (6) a cognitive approach to reading for the learning 
disabled, (7) reading comprehension processes as critical thinking, 
(8) exemplary studies for teachers to use, (9) using background 
knowledge of readers, (10) teachers as researchers and present 
research needs, (11) measurement in reading comprehension research 
and in classrooms, and (12) a synthesis and assessment of reading 
comprehension research. The appendixes provide a taxonomy of reading 
comprehension variables, a list of hypotheses that reading 
researchers test, the references for the 594 studies, additional 
references; and information about the authors and editor, (HOD) 
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PREFACE 



AN OVERVIEV/ OF LAliPSCAPES 
Avon Crismore 
Indiana University 



In 1983 the Federal Government funded a major assessment of 
reading comprehension research and practice for purposes of 
improving the teaching of reading comprehension for special 
education students. .This volume, the first of. a two volume set, 
addresses the first part of the grant — a state-of-the-art 
assessment of reading comprehension. The size of this task 
precludes an exhaustive synthesis of everything that was learned 
daring the assessment, vrhiat we present in this volume instead are 
slices of the data that we gathered concerning the reading 
comprehension research conducted from 1974-1984. The authors of 
the chapters in this volume took their own paths as they explored 
slices of the landscapes; topics were chosen by the authors based 
on their personal interests and areas of expertise. The volume 
gains its unity from an overall perspective comprised of the 
underlying assumptions, beliefs, and principles held by the 
research team. 

This volume is an exploration of charted and uncharted 
landscapes of 1) the subject matter — reading comprehension 
research, and 2) the methodology meta-analysis. We have used 
the metaphor of landscapes, a series of vignettes and 
scenarios, and a variety of visual displays to try to help make 
our presentation more accessible and interesting to a wide array 
of readers* We saw taat our task was to inform our readers about 
what was happening in reading comprehension and what this then 
implies for classroom teachers - how they might better understand 
and make use of what we found. V7e have attempted to be as 
practical and applied as possible by identifying 1) current 
practice, 2) needed changes, 3) suggestions for how to go about 
making the needed changes, and 4) issues and questions generated 
by current research. We have attempted then, to lay the 
conceptual groundwork so that others might explore many of these 
generated issues and questions with further research; design 
exemplary reading comprehension programs, curricula, instructional 
materials, and demonstration sites; and develop alternative 
ir.othois '^^f assessing reading ci.^ii prehension. 



Bcl iefs rind Assumpt ions 



We believe that all students are special education students. 
Because of their individual differences in mental and physical 
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abilities, in pernanent personality traits anl ter^porary mental 
states, in attitudes and beliefs, and in background experiences 
and opp— tunities to learn - all students need a special education 
in reading comprehension. The information contained in this 
volume should help teacher-^researchers and teacher researcher 
collaborators gain a better understanding of how to accomplish 
such reading comprehension goal. 

Ke also believe that teachers should consider themselves as 
teacher-rresearohers and that this volume can help show teachers 
why this is important and how it can happen. In addition, we 
believe that just as integrating and synthesizing the data for 
this project was the result of a social process and a social 
construction for the members of the research team^ so too is the 
integrating and synthesizing that is needed for reading 
comprehension dependent on a social process and a social 
construction involving both learners and teachers. Interpersonal 
relationships between teachers and students, students and 
students, and authors and readers are necessary for improving 
reading comprehension. 

Finally, we believe that the meaning of the prefix meta needs 
to be broadened to include the critical and speculative as well as 
the objective, systematic, and analytical aspects. In analogy to 
metaphysics or metacommunication, a meta-analysis would consist of 
conceptualizations that are not part of the analysis itself but 
that are about the analysis* It is a going beyond analysis to 
include » ot only descriptive judgments but also evaluative 
judgments. A meta-analysis, because it is self-reflexive, 
involves a coming at it from a subjective, biased viewpoint. 
Therefore, it necessarily must be evaluative but it is also 
objective, systematic, analytical, and explanatory. A meta- 
analysis that does n:>t do any self-reflection of the methodology, 
i.e. that only reiterates the data finding, is a 

pseudo-meta-ana lysis. We are arguing that our meta-analysis is a 
true ineta-analysis; in fact, it is a meta-meta-ana lysis. This 
perspective provides a framework for our volume. 

In addition to presenting a synthesized view of the state-of- 
the-art by pulling together ten years of research and pointing out 
the important trends and how the specifics of the studies relate 
to teachers, students, and classrooms, we also wished to be 
practical and applied regarding methodology. Thus, our volume 
provides natural history of the research project - the plans and 
change^r in plans, the rationales and justifications, the 
procedures and processes, anl the strengths and limitations found 
for quantitative and qualitativie meta-analysis. We believe this 
will be useful not only for understanding this volume, but also as 
aids for other research projects similar to this one. 
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The references for the 594 studies in the data set represent 
'a refined tool for focusing on specific areas in reading 
comprehension roseaxch without undergoing time-consuming, costly 
literature searches- They are presented in an organized 
systematic way to allow teachers/ graduate students, and 
researchers easy access and use. 

Part I, the prologue, consists of two chapters. Short argues 
in Chapter 1 that both quantitative and qualitative meta-analysis 
are necessary for a complete state-of-the-art and state-of- 
knowledge understanding of any domain. She supports her case by 
siting the strengths and weaknesses of both kinds of meta-analyses 
~ the relatively new quantitative approach and the more 
traditional narrative reviews of the research. She concludes with 
a redefinition of meta-analysis which sets the scene for the rest 
of this volume. In Chapter 2, Rowe and Harste describe in depth 
the history of the research project and the plans and procedures 
ased. They give descriptions of the taxonomy and coding sheets, 
the rationales for using quantitative and qualitative meta- 
analysis, and the methods and procedures for both. These two 
chapters provide needed background information for understanding 
the rest of the volume. 

In Part II Rowe reports the findings of the quantitative 
meta-analysis and supplements those with caveats for the reader. 
She concludes by stating that the important contribution of 
quantitative meta-analysis is its ability to delineate the 
patterns and trends for reading comprehension research during the 
past ten years. 

Part III continues by reporting the findings of the 
qualitative meta-analysis. The eight chapters in Part III present 
eight slices of the data that was gathered. 

Rowe authored the first slice, Chapter 4, a guided tour of 
the landscapes. This chapter presents an overview of the important 
trends in instructional reading comprehension research using the 
rateaories of reader, text, task, and proces'^.ing strategics. 
Stephens follows in Chapter 5 by presenting a summary of the 
specictl education reading ^'"omprehons ion research. She makes the 
point that the findings from research in regular classrooms no 
doubt apply equally as well ti special education classrooms. She 
presents a list of questions generated by these studies and offers 
a 1 ist of possibly helpful strategies for teachers. 

In Chapter 6 Busch discusses a new way to look at reading 
comprehension for the learning disabled. She sees social 
interaction and metacogniti vc monitoring as useful ways to improve 
teaching of reading comprehension and at the end of her chapter 
offers a compendium of strategies for teachers to use. Chapter 7 
offers another new approach to tOiiching reading comprehension. 
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Shw'^rt .lefines an! explains critical thinking as a needed approach 
for teaching reading and critiques a number of instructional 
studies based on the extent to which they promote critical 
reading. Short finds most of the studies wanting in this respect. 

In Chapter 8 Dahl and Roberts discuss and comment on the 
exemplary studies that teachers might use as models in their 
teaching. Each author responds not only to the studies, but to 
each others' reactions as well. Heine's slice in Chapter 9 
focuses on background knowledge of readers. Heine categorizes 
background knowledge into four types: content, structure, 
pragmatic, and strategy and then synthesizes the studies for each 
type. He raises some concerns about the lack of research on the 
interactions among context and reader background knowledge* 

In Chanter 10 Snyder looks at the research with teachers as 
collaborators or as teacher researchers. She argues that teacher- 
researcher is critical for effective research for and gives 
practical suggestions for how teachers can become teacher- 
researchers. 

In Chapter 11, Cousins synthesizes the finding for the kinds 
of measurement used by reading researchers to assess reading 
comprehension anH the possibilities of these as alternatives to 
the kinds of measurement now used in classrooms. She discusses 
the similarities and differences between research and classroom 
measurement and points out areas for further research in 
measurement . 

The volume ends with Part IV, Harste's meta-meta-analysis in 
Chapter 12. Harste sketches a portrait of the newly emerging 
paradigm in readinvj cvimprehension based on evidence from the data 
base. He examines the underlying assumptions of the reading 
comprehension researchers and identifies three major shifts in 
assumptions that help explain the patterns of dominant and non- 
ioninant hypotheses found in the meta-analyses. He then gives the 
characteristics and promises of the new paradigm. 

We believe the appendices are an important part of the 
volume. In Appendix A we have provided a taxonomy of reading 
comprehension variables that both researchers and teachers can use 
as guidelines in designing research and curricula. The multiple 
coding concent demonstrates how a research study can be coded on 
nany aspects for a richer, more flexible method of interpreting 
'ind applying conprehension research. Appendix B contains a list 
of hypotheses that reading researchers test which we hope will 
invite stimulating discussions and new research designs. Appendix 
Ccontains the references used for the 594 data base studies, and 
Appendix D additional references. Information about the authors 
and editor is found in Appendix E. 
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Composing this collection of landscape slices has been as 
creative an endeavor — inteiebt ing, challenging, and satisfying 
— for me the editor as, I am certain, it has been for the author 
of each chapter. Our hope is that this also holds true for you 
the reader-composer. V^e invite you to experience our landscapes 
from different perspectives and for different purposes. Each 
shift of perspective will give new and deeper understandings of 
the state-of-our current knowledge and beliefs about reading 
comprehension and its application in classrooms. 
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CHAPTER 1 



A TOOL FOR SURVEYING THE LANDSCAPES: 
THE CASE FOR BOTH QUANTITATIVE AND QUALITATIVE META-ANALYSIS 



Kathy Gnagey Short 
Indiana University 



INTRODUCTION 



The field of education, along with other social sciences^ has 
experienced an explosion of research in the la>t twenty years. Cooper 
(1982) points out that most researchers today cannot keep up with 
primary research reports except in a few areas of specialization. 
Consequently, both researchers and teachers are relying more and moYe 
heavily on integrative research reviews to synthesize separate 
empirical findings into a coherent whole that can be used in infor^Tiing 
future research and classroom practice. These integrative research 
reviews have provided readers of research with a way to quickly survey 
a landscape that has become so broad that one person can no longer 
explore and know every part of it. 

One technique or tool of surveying the landscape of individual 
research studies has received a great deal of attention recently,. This 
tool IS iTieta-analysis and was proposed by Glass (1976) as a rigorous, 
quantitative alternative to more casual , narrative discussions of 
research. Since then, meta-analysis has been the topic of a debate 
which has ranged from viewing it as a passing fad to believing that it 
will become an integral part of all research methodology. This chapter 
is an attempt to help researchers and teachers better understand this 
debate by discussing the various ;.ssues involved in using meta-analysis 
as well as its strengths and limitations as a good surveyor of the 
landscape. A good understanding of the technique of meta-analysis is 
essential to the reader of this book because the data base and review 
procedures that under ly the following chapters were based on meta- 
analysis. In addition, because of its current popularity among 
reviewers, teachers and researchers need to understand the technique in 
order to evaluate the usefulness of findings from other integrative 
reviews based on meta-analysis and to have a basis for making decisions 
on whether or not to use meta-analysis as a synthesis technique in 
their own work. 

This discussion of meta-analysis will be based on a review of the 
literature available on quantitative meta-analysis, especially the 
various articles written by Glass who introduced the technique. It 
will also be based on out experience as a research team conducting a 
meta*-analysls on reading comprehension as part of a US Department of 
Education contract to survey the state of reading comprehension, 
particularly as it relates to special education students. 
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As out research team attempted to use meta-analysis, it became 
obvious Lo us that the traditional definition of meta-analysis as a 
quantitative tool was too restrictive and eliminated valuable 
information which was needed in order to be able to interpret the 
findings. We, therefore, chose to expand meta--analysis to involve both 
quantitative and qualitative syntheses of research* The quantitative 
scores by themselves^ had no meanang apart from the context within which 
the research and instructional procedures were conducted and so were of 
limited usefulness. A major contention of this chapter is that we need 
to redefine meta-analysis if we want our surveys of the landscape to 
better reflect that landscape and to help us more productively continue 
our journeys through that landscape* 

This chap-ter will initially discuss meta-analysis based on its 
traditional definition as a quantitative analysis. It will first of 
all look at the rationale for the technique of meta-analysis by 
discussing 1) the role of integrative research reviews, 2) what meta- 
analysis is, and 3) the limitations of traditional narrative reviews. 
The next section of the chapter will critic/?lly analyze meta-analysis 
by examining A) the strengths and limitations of meta-analysis in 
relation to the major stages involved m conducting a meta-analysis and 
by arguing for 5) a redefinition of meta-analysis that involves both 
quantitative and qualitative reviews of research. 



INTEGRATIVE REVIEWS 

Jackson (1980) points out that research reviews are a fundamental 
activity in the social sciences but that the focuses and purposes of 
such reviews vary considerably. Some reviews are primarily focused on 
summarizing new substantive and/or methodological developments m a 
specific field. Others are interested m verifying existing theories 
or developing new theories, *hile still others are interested in 
synthesizing knowledge from different fiqlds of research. Integrative 
reviews, however, are those reviews that are focused on inferring 
generalizations about substantive issues from a set of studies which 
directly studied those issues. 

While integrative reviews are seen as playing a vital role in 
educational research, there is not agreement over what that role is. 
Cooper (1982) believes that the role of integrative reviews is to 
define the state of knowledge. The goal is to summarxze the 
accumulated state of knowledge r.oncernmg relations studied and the 
important issues unresolved by the researchers. Others, such as Cook 
and Leviton (1980), believe that the research review should establish 
"facts"; the dependable relationships that are found across a variety 
of studies despite any biases that may exist withm individual studies. 
Whether research reviews are 5;ecn as establishing truth or giving a 
state of the art, it is clear that they play a major role in 
eaucational research* Olkm (1984) argues that no single study can 
deal with the complexity of educational problems and so reviews are 
needed to integrate a large number of studies on the same problem in 
order to begin to deal with that complexity. 
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META-ANALYSIS 



Class^ McCaw and Smith (1981) point out that m the past narrative 
reviews were able to synthesize research related to any one topic 
because there were so few studies m one area. In the last twenty 
years, however, there has been a tremendous growth m the number of 
studies and the chronological verbal descriptions of research which 
have been used to integrate studies narratively have become inadequate. 
Researchers have begun to make v,rude represent<»tions of the findings 
which have often been misleading. 

Glass, in his 1976 AERA presidential address, proposed a new 
technique, called meta-'analysis, which he felt would better meet the 
needs of research integration today. He noted thai, the findings of 
multiple studies should be regarded as a complex data set that is no 
more comprehensible without statistical analysis than the hundreds of 
data points m a piece of primary research. Glass (1976) called for an 
approach to research s-.nthcsis that used the same standards of rigor 
expected of primary research. Rather than review^ being narrative and 
rhetorical. Glass' proposal was to use meta-analysis so that reviews 
would be more technical and statistical. 

Meta-analysis is described by Gl^ss (1976) as an "analysis of 
analyses." He defines it as a statistical analysis of a large 
collection of tindmgs from individual studies for the purpose of 
integrating the findings. Glass (1976) believes that meta-analysis can 
provide a way to portray multiple tmdings quantitatively and aggregate 
these findings across potentially irrelevant distinctions. The purpose 
of meta-analysis, according to Class, is to discover knowledge by 
summarizing studies m such an orderly way that knowledge can be 
extracted from the individual stucies. 

Jackson (198U) states that Glass' meta-analysis involves 
transforming the findings oi individual studies into a common metric, 
coding the various characteristics of these studies, and then using 
standard statistical procedures to determine the overall effects, 
subsamplc effects, and the relations between the characteristics and 
the findings. Glass, McGaw and Smith (1981) see the essential 
characteristics of meta-analysis as; 1) quantitatively synthesizing the 
findings of studies related to a common problem area; 2) looking at all 
the research related to the problem area; and 3) aiming at 
generalizations. The statistic used to quantitatively synthesize the 
findings of the studies is the effect size. This score is figured 

by taking the difference between the treatment mean and the control 
mean and dividing it by the standard deviation of the control group. 
(Glass, 1978) 



FIGURE 1: STATISTIC FOR GAIN EFFHCT SIZE 



Gam effect 



Treatment mean - control mean 



Standard deviation of control group 
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LIMITATIOKS OF l-RADlTIONfAL NARRATIVE REVIEWS 

One of the strengths of Taeta-analysis, according Lo proponents of 
the technique* is siaply that it is an iiaprovement over the narrative 
research review. Class (1978) believes that narrative reviews are 
subjective and often pure speculation while meta-analysis is objective 
and systematic. He sees it as a rigorous alternative to the casual* 
narrative discussions of research studies* 

Cook and Leviton (1980) point out some of the problems with the 
traditional narrative reviews- They note that these reviews often are 
biased in their sample of studies because of a narrow literature 
revien, the exclusion of studies on methodological grounds or due to 
theoretical constructs, and the use of narrowly defined constructs. 
Many narrative reviews fail to take into account statistical 
interactions that exist m studies and ignore important information on 
the magnitude of relationships and directions. Cook and Leviton argue, 
however, that these problems are the results of poor practices rather 
than inherent problems m the narrative reviews themselves. 

Cooper and Rosenthal (1980) did a study in which they had forty 
people use either narrative or statistical review techniques on the 
same seven studies. They found that those doing the statistical 
reviews showed increased support of the perceived hypothesis and for 
the estimated magnitude of the relationship. Those doing the narrative 
reviews tended to be overly conservative and either ignored the 
statistics or combined them m an intuitive fashion. They also noted 
that the narrative reviews were responsive to the biases of the 
particular reviewer, neglected large amounts of information in the 
reports, and imprecisely weighted the conclusions. 

Jackson (1980) did a survey of thirty-six published narrative 
research reviews and also came up with critical comments about these 
reviews. He found that the reviewers often did not critically analyze 
or use the findings of past reviews on that same topic; that the 
studies reviewed were only a subsample of what was available, were not 
a representative sample and that there was no discussion of how they 
were chosen, that crude and misleading representations were used to 
Combine the findings; there was a failure to systematically assess 
possible relationships between characteristics and findings of studies^ 
and that the methods used to do the review were not discussed by the 
reviewers. Jackson (1980) concludes that narrative 'reviews lack rigor 
and standardization and result in few trustworthy conclusions. He 
argues that the lack of explicit methods for research reviews makes it 
difficult to judge the quality of reviews, to tram graduate students 
.n how to do reviews, and to accumulate valid knowledge from previous 
research* 

Light and Smith (1971), as well as Hedges (1984) and Olkin (1984), 
talk about the inadequacies of past methods of combining the results 
from studies. The quantitative method that Is most commonly used and 
which IS often referred to as a "crude rcpresentaticn" is the box score 
or voting method. This consists of classifying each study according to 
whether or not the study found statistical significance. Each study is 
scored as either having positive significance, negative slgniJ icance, 
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or no significance and the "votes" are counted' up in each column after 
scoring all the studies* Problems with thi^ technique include the fact 
that It Ignores sample size and so can be biased m favor of large 
studies with weak results and that it does not take into account the 
magnitude of the relationship* It also omits those studies where a 
relationship went m a certain direction but was not statistically 
significant. Both Hedges (1984) and Olkin (1984) point out that this 
test does not have much statistical power and that the probability of 
error actually increases as the number of studies included increases* 
This test is biased toward a modal finding of no statistical 
significance and ignores statistical interactions. 

One other method that has been occasionally used xs to take all of 

the significance tests and combine them into one test of the null 

hypothesis. The problem is that there is such a large K that this 

approach results m the rejection of the null hypothesis in almost all 
instances. (Hedges, 1984) 

The movement toward quantitative meta-analysis is thus a 
recognition of the inadequacy of traditional narrative methods of 
research synthesis m the wake of the sheer number and complexity of 
educational research studies. The current interest in meta-analysis 
has resulted m the technique becoming the focus of a debate over 
whether it is a passing fad or an integral part of research 
methodolotty . The next section of this chapter will look at this debate 
by discussing the strengths and limitations of meta-analysis- This 
discussion will focus on the major stages involved in meta-analysis and 
the controversies involved at each particular stage. These five stages 
are those discussed by Cooper (1982) as characterizing the research 
process of integrative reviews: 1) problem formulation; 2) data 
collection; 3) data evaluation; ^) data analysis a»id interpretation; 
and 5) presentation of results. 



FICtRE 2: THE FIVE STAGES OF INTEGRATIVE REVIEWS 



PROBLEM FORMATION 
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PROSLEM F0RMIJLATIP5J 



The tirst stage m quantitatxve meta-analysis is that of 
toraulatmg the problem or area that will be the focus of the 
integrative review. Glass, McCaw and Smith (1981) point out that a 
major strength of meta-analysis is that is allows the conceptual and 
operational definitions to be broadly defined so that a larger domain 
of research can be included m the research review. Thev maintain that 
employing broad conceptual definitions gives greater validity and the 
potential for more definitive and robust conclusions. Even if the 
problem is more broadly defined m a narrative review, the reviewer 
runs into the problem of cognitive overload because of the aheer number 
of studies being dealt with. (Cook and Leviton, 1980). 

It is extremely important, however, in setting up a broad 
definition of the construct, that provisions are made for making 
important distinctions between studies. Attention must be paid to 
study details so that important distinctions are not missed. If the 
categories are too broad, differences between studies are cancelled 
out. Cook and Leviton (1980) maintain that the use of broad 
definitions of constructs leads to a disregard for theoretical 
relevance and a vulnerability to misleading inferences. The taxonomy 
developed for coding the data xn stage three of the review process 
determines the amount and kinds of distinctions retained between 
studies. The problems associated with developing a taxonomy that 
maintains a balance between retaining important distinctions between 
studies and making too fine of distinctions will be discussed under 
stage three, the evaluation of data. 

Bittle (1984) points out that meta-analysis assumes that simple 
relationships exist between the terms « concepts and operations used m 
research. He feels that while the technique works adequately when 
dealing with fairly concrete variables such as class size, there are 
problems when zt tries to deal with more abstract areas such as 
intelligence where there is a great deal of disagreement over what the 
term means. We certainly found this criticism to be true for the term 
reading comprehension which was the focus of our meta-analysis. We 
included m our data base any research study that used reading 
«.ompre hens ion as an outcome measure and so this brought into the data 
base a wide variety o£ studies and definitions of reading 
v.omprehension- There are about as many definitions of comprehension as 
there are research studies. The area of reading comprehension 
instructional research is very complex and, because it deals with 
instruction m classroom settings rather than only laboratory settings, 
jt tends to be a much "messier" form o{ research. Our experience was 
that in order to use the technique of meta-analysis with reading 
«-ompr ehension, we needed to develop <i complex taxonomy and, even then, 
constant problems came up with each new study as to how to code the 
important distinctions between this study and others already in the 
meta-analysis. 
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DATA LOCATION' AND COLLECTION 



The second stage of ©eta-analysis is that of locating and 
collecting the data. Glass, McCaw and Snith (1961) stress that an 
exhaustive search needs to be done to locate all t.he relevant published 
and unpublished research in that area. All kinds of both primary and 
secondary sources need to be used m order to locate as much research 
as possible. Glass (1978) feels that this is the stage where the most 
serious form of bias can enter. A validity threit exists in relation 
to whether the retrieved studies differ qualitatively from all studies 
m a particular area. Glass (1978) calls for thorough descriptions of 
procedures used to locate studies so that readers can assess the 
representativeness and completeness of the data base. 

Glass, McGaw and Smith (1981) looked at nine meta-analyses that 
included both published and unpublished research and found that the 
average gam effect size for published studies was higher than the 
average gam effect size for unpublished studies. Therefore, if the 
meta-analysis does not include unpublished work, it will be biased in 
the direction of positive results and so produce misleading 
genera 1 i za t i ons . 

There is relatively little disagreement over Glass* assertion that 
a very thorough search needs to be done to find as many studies as 
possible on a pc^rticular topic. The disagreement comes as to whether 
all of the studies which are located shov Id go mto the meta-analysis. 
This issue will be discussed m the next stage. 

A problem that our team ran into during this stage of the meta- 
analysis was the extreme amount •>£ time involved m doing the kind of 
search needed, especially m locating unpublished studies. Enormously 
more personnel and time were involved than had ever been anticipated. 
The descriptors used in standard indexes such as ERIC were not 
satisfactory for the type of search needed and so many hand searches 
had to be done of Journals and bibliographies- This stage in the meta-^ 
analysis was both time-consuming and expensive m order to do the kind 
of thorough search advocated by Glass. The team also continually felt 
the frustration of knowing that not all the studies, especially 
unpublished studies, were being located and not being sure whether the 
sample of studies in the meta-analysis was representative of the total 
population or was biased m some way. 



The third stage m meta-analysis is coding and evaluating the 
data. This is the stage at which the most controversy exists and where 
there arc disagreements as to how to conduct a meta-analysis. This 
stage involves developing a taxonomy and coding form and making 
decisions about what studies to include in the meta-analysis* 



Glass, McCaw, and Smith (1981) pr».nt si.t chat both substantive and 
methodological features of studies should be coded. The substantive 
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teaLures are those characteristics specific to the problem being 
studied. The tsethodological features are more general and are related 
to such things as the research design, sample size, test reliability, 
randomness, etc* A taxonomy must be developed which includes both of 
these areas so that an analysis can be made of whether findings differ 
according to certain characteristics of the studies. This taxonomy 
must allow for a full, meanmgul description of the findings. Glass 
(19*^5) supports making many distinctions and then later obscuring them 
when It becomes apparent that dificAences do not exist. 

The taxomony is extremely important in determining what kind of 
interpretation will be possible from a meta-analysis. After examining 
a number of other meta-analyses m reading, our team concluded that 
their coding systems did not make tine enough distinctions between the 
treatments and were not theoretically based. An initial coding system 
w^s developed by examining 30 comprehension studies. However, this 
taxonomy was continually revised and categories added, revised and 
deleted as actual coding of studies continued. Despite the complexity 
of our taxonomy, we still ended up with a few categories that became 
"dumping grounds" for all kinds of studies. A great variety of studies 
were put into these categories and so it was difficult to make any 
kinds of generalizations about those categories. Since our taxonomy 
appeared to more finely discriminate between the characteristics of 
treatments than other meta-analyses, this would seem to be a major 
problem m these meta-analyses. 

The taxonomy used in our meta-analysis was theoretically based 
both m determining the four major dimensions that each treatment was 
voded on (reader, processing, task and text characteristics) and in the 
sub«-ategorics arranged under each of the major categories. While this 
proved to be n real strength of our coding system and facilitated the 
kinds ot interpretations that could be made from the data, other meta- 
analyses ao not appear to have taxonomies which have this theoretical 
basis. One major problem with our taxonomy was associated with 
breaking a wholistic process into four major categories. These four 
categories can not be viewed separately from each other and yet -the 
tciKonomy attempts to separate out each category with the admonition 
that each category c<in only be interpreted in relation to the other 
three categories. All quantitative meta-analyses would seem to suffer 
from this same problem of separating out categories whtch don't really 
exir*t and which can really only be understood by their transactions 
with other categories. 

Our team has felt that the taxonomy has been the real strength ol 
doing the meta-analysis. It has given us a way to organize, 
synthesize, and evaluate a very large data base that would otherwise 
seem unmanageable. The development of the taxonomy is thus a very 
important part of the meta-analysis and will determine whether or not 
the meta-analysis adds to the field's understanding of the area being 
synthesized. Our experience also demonstrates that the taxonomy will 
f ontinuc to change as mote studies are coded and that to determine the 
taxonomy "a prion" without making adjustments during the meta-analysis 
will limit the validity of the taxonomy. However, on the other hand, 
the continual refinement of the taxonomy requires recoding earlier 
studies and so the research team ran get into a vicious circle of 
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coding and recodinj* which could potentially never end unless decisions 
are soade about what to recode and how many changes to make in the 
taxonomy after a certain point in the meta-analysis process. 



Class, McCaw and Smith (1981) talk about several problems at this 
stage with validity and reliability. The validity of meta-analysis can 
be effected if the coders need to do a great deal of inference of the 
study characteristics in order to code the study due to incomplete 
reporting by some researchers. We found this to be a problem in 
reading comprehension research. We ended up writing to many 
researchers asking for missing information. Control groups, in 
particular, were not usually described and so we had to make inferences 
about what we thought they might be doing. For example. Weaver (1979) 
states that the control group remained in their classroom and received 
no treatment. Cartelli (1977) states that the control group received 
no special training other than that normally obtained in the LD 
classroom. Ko other information about the control groups is provided 
in either of these studies and so the coding team had to make an 
inference on what "normal" instruction is. In addition, we found that 
some journals published only short reports of research and that, 
because of this, the research reports were not complete enough for us 
to always be able to tell what was really happening in a particular 
treatment. 

RELIABILITY 

Under reliability. Glass, McGaw and Smith (1981) di scuss the 
importance of mterrater reliability. There needs to be consistency in 
how the coders are coding the different characteristics of studies. 
Stock, Okun, Harlng, Miller, Kinney and Ceurvorst (1982) conducted a 
study of interrater reliability on a meta-analysis. They looked at the 
reliability of judgements m selection and acceptance of sources and of 
judging and coding decisions about study characteristics. They found 
that they were able to reach satisfactory levels of interrater 
reliability m all areas except for study quality. Our experience was 
also that this category was the one most open to the reviewer's bias of 
"Did I like this study?" rather than of explicit criteria. 

Stock, et al. (1982) poirt ouL the importance of well designed and 
piloted coding forms, a detailed coding manual, coder training on the 
coding form and codcbook, continual checks of interrater reliability 
followed by more training to deal with problems, and procedures to 
incorporate new coders. They also note that discussion among coders 
increases the quality of the coding. This last point is another one 
that our team found very important. The initial expectation had been 
that wc would spend several sessions coding together and then that each 
person would code individual studies. What we found was that wc needed 
to continue coding as a group for a long period of time and that even 
after that, each study needed to be checked with another person« This 
may have been partially due to the complexity of our coding system and 
to the great variation in the research being coded. While the numbers 
make the process look as if it is "hard science," our expevience was 
that coding was a social construction of what we decided to look at and 
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how we looked at it* We made decisions by social consensus. Glass 
sees meta-analysis as a very objective and systematic process while we 
. ound that the process was subjective and was socially negotiated and 
constructed. It scess obvious to us that soseone else could not pick 
up our coding form and be able to use it in the same way that we have. 
While we would agree with Glass that meta-analysis is a systematic 
procedure, we did not find it as precisely systematic as Glass has 
purported in the literature. 

Another aspect of coding that affects reliability is the change in 
the coders « We changed as coders a great deal in the process of 
coding. Decisions made after several months of coding were different 
from those made early in the coding and were based on the background of 
the research that had already been coded. This became very apparent 
when two new coders came into the team after four months and became 
very frustrated with the decisions that the rest of the team were 
having no problems making. They could not see the basis of these 
decisions and when pressed, we realized that they were based on that 
common background experience with past studies. The studies coded at 
the beginning have had to be recoded a number of times based on later 
decisions and it has become obvious that the system of coding will 
never stabilize completely - that up to the very end, we could continue 
to go back and make changes based on more recent coding decisions. 

THE APPLES AND ORANGES CRITICISM 

The most common and vehement criticism of meta-analysis is that It 
is comparing apples and oranges. Different definitions of the same 
construct, different populations, and different outcomes measures are 
all throim together and critics argue that only studies which are alike 
m some respects should be aggregated. Glass • response Is that meta- 
analysis IS no different than mixing together the data from different 
people in primary research. (Glass, McGaw, and Smith, 1981) He argues 
that the only studies that need to be integrated are those that differ. 

Gallo (1978), In particular, criticizes data in which effect sizes 
arc computed from heterogeneous measures. Glass, McGaw and Saith 
(1981) respond that since the outcome measures are all related in some 
way to the construct, in the end they are all general measures of that 
construct. GLnss believes that the type of measure should be coded and 
later compared to see if this has an effect on the gain effect size 
score. 

In our meta-analysis, we decide to Include all studies which 
assessed reading comprehension and so this involved a tremendous 
variety of studies* We attempted to deal with this diversity of 
studies by coding distinctions between studies. Our assumption was 
that in the next stage of data interpretation we would look at each ot 
these factors separately as Glass suggests in order to see if they 
effected the results. However, as will be discussed in the next 
section, once we moved into data interpretation, we realized what on 
important issue the criticism of "apples and oranges" was. 
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The second major criLicxsm is that Glass advocates the use of poor 
quality research in reviews. This stems from Glass* recommendation 
that all the research be coded and that methodological decisions not be 
made "a prion." Eysenck (1978) claims that Glass Is supporting low 
standards ol quality for research and abandoning critical criteria for 
evaluating the quality of research. He maintains that only the 
findings from well designed studies should be included. 

Glass ( 1978) points out that even imperfect studies can converge 
on a true conclusion and that he is judging the quality of studies. 
His position IS that research quality should be coded and then looked 
at at the end of the coding to see if the effect sizes differ for poor 
quality vs. good quality research. If they do, then the good quality 
research should be given more weight. However, both Glass (1978) and 
Hedges (1984) note that in the meta-analyses that have been done so 
far, the quality of the study has had no or very little effect on the 
gain effect sizes. Glass (1978) feels that to make judgements "a 
prion" is to inject a serious source of bias since even though these 
decisions are being made on methodologicol grounds, personal bias often 



Others doing meta-analysis do not always follow Glass' dictum on 
this issue and do make inclusion decisions based on methodology. 
(Kulik and Kulik, 1982) Jackson (1980) points out that a problem with 
making this kind of decision is that roost studies have some type of 
methodological problems and that these problems do not always cause 
bias. Harste (1984) also points out that most research, especially 
research done in classrooms, has methodological problems and that there 
are few "good" studies out there. Slavin (1984) notes that there are 
problems when a meta-analysis includes methodologically poor studies 
where the flaws have a systematic bias m a certain direction rather 
than a randomized bias as Glass assumes they do. He believes that the 
inclusiveness requirement should be removed and that meta-analyses 
should throw out studies with systematic flaws in order to prevent a 
serious potential bias 

While our team chose not to exclude studies due to methodological 
problems and to code internal and external validity, it soon became 
obvious that many categories were being filled with studies that had 
weak internal and external validity. For example, we found that 95% of 
the studies used dependent measures developed by the researcher rather 
than standardized measures. There was very little pilot testing of 
these measures and no testing of their validity or reliability before 
using them in the research study. Paris and Jacobs (1984) report a 
study based on a roeta-awarenc" a interview In which they ended up 
throwing out a majority of the questions from the analysis because of 
various problems. This should have been done in a pilot study. These 
and other methodological problems zuch as durations of less than one 
week raised questions about the effect of research quality on the mean 
gain effect sizes. Less than 5% of all the studios coded In our meta- 
analysis received codings of both high Internal and external validity. 
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THE PROBLEM OF RESEARCH STATISTICS 

Another problem that our team encountered was the amount of 
research that could not be included m the meta-analysis because they 
did not have the right statistics. We coded only studies that included 
means and standard deviations and had a control group- This omits 
ethnographies, descriptive research, correlational studies, and many of 
the more complex mul ti-var iate studies being done today- Glass (1978) 
does giN^e transformation formulas for transforming F statistics, 
correlations, etc- into gain effect scores. However, these 
transformations are only estimates of the gam effect sizes and there 
have been no proofs yet of these transformations. It therefore seems 
risky to use transformations unless absolutely necessary and this is 
what our team chose to do, which then involved excluding a great deal 
of research from the meta-analysis and made it necessary to use other 
kinds of synthesis for this large group of studies. It also meant we 
could not know for sure how representative the group of studies 
included m the meta-analysis was of the entire body of research in 
reading comprehension- It cannot be assumed that the many studies 
excluded from the meta-analysis did not reflect distinct differences 
from those included in the meta-analysis- 

Examination of other meta-analyses such as one done by Pflaum, 
Walberg, Karegianes^ and Rasher C1980) on reading instruction methods 
indicates that they also had to omit studies because of the lack of 
inferential statistics and control groups. However, no discussion or 
analysis is made of the excluded studies and whether they would have 
changed the findings. Meta-analysis reflects a theoretical orientation 
that only accepts specific, quantifiable kinds of results and so a 
great deal of important scholarship is likely to be discounted if no 
other type ot synthesis is made of studies excluded from laeta-analysis - 
What IS most commonly called "naturalistic" research is not amenable to 
quantitative meta-analysis and this research is currently growing in 
number and contribution to the field of language and education. 



DATA ANALYSIS /\Np INTERPRETATION 

Thxs stage of the meta-analysis involves analyzing and 
interpreting the data that has been coded. In this stage the effect 
sizes are compared across the study characteristics and standard 
statistical procedures arc used to make all kinds of inferences. The 
ctfect sizes from individual studies become the dependent variables in 
meta-analysis and the substantive and mcthdodolgical study 
characteristics become the independent variables. The effect sizes can 
then be combined into various kinds of aggregations based on these 
study characteristics. The effect sizes can serve primarily as 
description, or can be subjected to a full range of inferential 
statistical techniques. (Kavalc, 1983) 

NON-INDEPENPENCK OF CAIN EFFECT SCORES 

A major controversy at this stage is what to do about the fact 
that each study contributes more than one gain effect score into the 
meta-analysis. Since meta-analysis is conducted on large data sets in 
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which multiple results are derived from the same study, the data are 
not independent from each other and give a mistaken impression of the 
reliability of the results. Our experience was that some studies put 
m 60 or more gam effects scores while other studies contributed only 
5 gam effect scores and that the average was around 11 gain effect 
scores per study- This gives unfair weighting to certain studies and 
allows one study to dominate an entire category and the conclusions 
being drawn from that category. There aro several proposals of how to 
deal with this issue. Some meta--analyses simply ignore this criticism 
and proceed as if each finding were independent of the other findings 
while others average out all the findings within a study up to the 
level of the study and then proceed with the meta-analyis with 
"studies" as the unit of analysis. Glass (1978) recommends using 
Tukey's jackknife method as a way to take account of the 
mtordependencics . Our research team has also discussed the 
possibility of going back to each study and choosing one or two gain 
effect scores from each study which arc representative of the major 
focus of that study* 

EQUAL BIAS 

Cook and Levi ton (1980) point out that the problem of equal bias 
is a major consideration at this stage. They maintain that the use of 
effect scores assumes that there is equal bias across studies. This 
means that biases that inflate a relationship in one direction in some 
studies are counterbalanced by equally potent biases in the other 
direction m other studies. Others assume that the degree of bias can 
be estimated validly and that the studies can then be weighted to 
remove the bias- Bittle (198A) also argues vhat the use of inductive 
statistics assumes that the reviewers are dealing with an unbiased 
sample when this is not true. Any sample relects the methods, subjects 
and context of the study. He gives the example of the bias introduced 
by the fact that early research was all 'ionc with white, middle-class 
classrooms. 

Hedges (198^) maintains that before effect sizes can be compared 
there needs to be a test for homogeneity to see if the effects are 
consistent* He sees this as a way to deal with the "apples and 
oranges" criticism. He wants to make sure that important differences 
among outcomes between studies do not exist before proceeding with 
comparisons of gain effect sizes. 

Cook and Leviton (1980) also criticize Glass because he focuses 
primarily on global summary statements rather than on interactions. 
They feel that Glass tends to bias the analysis towards examining 
methodological characteristics rather than theoretical variables. This 
may be due to the fact that potential interaction variables of 
theoretical interest are not included in the taxonomy and so are not 
part of the data base. 

USE OF INFERENTIAL STATISTICS 

In addition, n major problem at this stage of the meta-analysis is 
the fact that proofs do not exist which demonstrate how valid the use 
of inferential statistics is with gain effect scores. It is at this 
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point that the "apples and oranges" criticism becomes significant. Our 
experience showed that we came up with average gain effect scores for 
subcategories that were virtually meaningless because of the diversity 
of studies whichwe knew were in a specific category. Studies were in a 
category such as inference which defined inference differently, used 
different techniques to teach inference, had various kinds of 
methodological problems, and used different kinds of dependent 
measures. Knowing that the category of inference has a specific mean 
gain effect score, therefore, does not mean anything unless one looks 
closely at the studies that went into that cell. 

Lack of standardization of control groups 

Another major problem with the use of mean gain effect scores as a 
way to compare studies and categories is that gain effect scores are 
based on the assumption that control groups are standardized. Gain 
effect sizes are calculated by taking the difference between the 
treatment mean and the control mean and dividing it by the standard 
deviation of the control group. However, control groups differ a great 
deal from study to study. In some studies, such as Hansen (1981) a 
control group exists which reads the same materials as the two 
treatment groups but does not receive that part of .he treatment 
dealing with the focus of the study, inference. In other studies, such 
as Adams, Carninc, and Gerstcn (1*"52), we are told only that the 
control group stayed in their classrooms during the training, and so wc 
have no idea on how many different dimensions the control group 
differed from the trfsatmcnt group. In still other studies, such as 
Garner and Anderson (1981), there is no true control group but instead 
there are three treatment groups, one of which serves as a control for 
the others. 

A tr\»j control should vary from the treatment only in relation to 
the manipulated variable and this was not true of many of the control 
groups that we coded. This meant that the comparison between the 
control and the treatment sometimes gave unfair advantage to the 
treatment group. It was also then misleading to compare gain effect 
scores between studies which used very different kinds of control 
groups because of the effect of the control group on the size of the 
gain effect scores. The closest thing to a standardized control group 
across studies would be what some researchers call "regular basal 
instruction." However ^ it is difficult to know what is always meant by 
this phrasing and there are many studies in which what the control 
group does differs considerably from "regular basal instruction." This 
problem with control groups xs not discussed in the literature on meta- 
analysis and wc found it to be a serious problem - one which shook our 
confidence in making much use of gain effect scores as inferential 
statistics • 

y§? ?E §9951^ VI SO ANALYSIS AND INTERPRETATION 

Our experience with gain effect scores was thus to use them 
cautiously and with reservation. Wc have tended to use them at a very 
global level and not to have much faith in them in comparison between 
specific subcategories. Therefore, while we feel we can comment on the 
overall gam effect sizes from the four major categories, we get uneasy 
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when trying to compare gain effect scores between specific 
subcategories such as inference or vocabulary. The gain effect sizes 
have also been helpful in looking at the effect of certain kinds of 
methodological decisions such as the changes in gam effect sizes based 
on length of the study» the use of standardized vs researcher generated 
dependent measures, etc. Another major problem was knowing how to 
determine how much difference there needed to be between gain effect 
sizes to know that one gain ettect score was significantly higher than 
another. Does having one gain effect score, being twice as high as 
another mean that that category or treatment is twice as good and has 
double the results of the other category? We worked with a number of 
different ways of comparing gain effect scores between categories and 
were not able to find any that we felt completely comfortable with. 
Whether or not a difference was important depended on what was included 
in the categories and a multitude of other factors. 

Taking a large gain effect size as an indicator that a certain 
treatment or category is better than another treatment or category can 
be very miatleading. For example, we found that studies which received 
a low internal validity rating had higher gain effect sizes; that 
studies which looked at lower levels of linguistic units » such as 
sentences rather than texts » had higher gain effect sizes; that 
researcher ^made materials, which often were manipulated materials that 
one would not use in the classroom, received higher gain effect scores 
than commercial materials, that researcher developed dependent measures 
received higher gain effect sizes than standardized dependent measures; 
and that high internal consistency between the dependent measure and 
the treatment resulted in higher gain effect sizes for treatment groups 
and low gain effect sizes for control groups. This suggests that 
sloppily done research or purposively manipulated research can result 
in higher gain effect scores than in carefully controlled experimental 
studies where the researcher has taken steps to lessen the effects of 
bias on the results. 

FIGURE 3: HIGH GAIN EFFECT SCORES 



Low internal validity + short linguistic units + researcher materials + 
nons tandardized dependent measures -f- high internal consistency with the 
treatment » high gain effect scores 



Therefore, our team found that using the gain effect scores as a 
way to analyze and interpret the data was not valid except perhaps in 
looking at very broad Categories and methodological variables and in 
indicating which categories needed closer examination. However, the 
taxonomy did provide a very useful tool for getting hold of major 
trends in comprehension research and providing a basis for synthesis 
papers which attempted to interpret both the studies included in the 
quantitative meta-analysis and in the syntheses done of studies 
excluded from the meta-analysis. RowCt in chapter 7, for exairple, 
discusses three important general trends which emerged by ex/«mining the 
studies in the various categories of the taxonomy: that mosl 
comprehension research has come to rest on a theory of reading which 




acktiowlodgus the ai Live role of the reador; Lhat lhor«» a mov"«- 
towards comprehciisio.. instrucLxon which fotu«t.s on hi^>her lovoK- k.i 
oognitive procossing; and Lhat readers are being t ucoura;t».ed Lhruu^;ii 
instruction to develop and become «iware of strategies which they can 
apply in other reading situations. Important roethodologi*. ai issues, 
such as the iir.dmg that around 65% of the treatments done in 
comprehension had a duration of less than a week, were identitu'd 
through examrnmg the various categories of the taxonomy. 1 her el ore, 
while we did not find the gain effect scores particularly useful or 
valid, the dat<> coded into the taxonomy was e^xtremely useful in m«iking 
further qualitative analyses. This same taxonomy was used as a basis 
lor examining studies which were excluded from the meLa-analysiti and 
this was helpful in lookxng at trends across the entire data ba,>e 
rather than only across the studies mcladed in th<» qu<^nti tctive meta- 
analysis . 



REPORTING THE RESULTS 

The last stage in a meta-analysis, consists of reporting the 
results to the public. Based on the previous discussion of meta- 
analysas, it should be obvious that to simply present the results of <- 
meta-analysis m a table which compares gain effect scores is 
inadequ«ite. Pt iaum, Walberg, Karagianes and Rasher (1980) report their 
synthesis of *97 reading methods studies in seven pages and two tables 
which give the mean gain effect size for each method. As argued in the 
above discussion on interpreting the results, the gain effect sizes by 
themselves really have no meaning. We have chosen to write a series of 
synthesis papers which attempt to discuss the major trends and insights 
gained from both the quantitative meta-an«ilys i s and the qualitative 
syntheses rather than issuing a series of tables of gain effect scores. 

Slavin (198*4) states that the report of a meta-analysis should 
an« lude a good disrussion of the major st*idi**^ on which it is based. 
The effect sizes should not be treated as primary data and the 
researcher describe only the study selection and statistical proreduies 
as in the Pflaum et al . study. The studies included must be discussed 
just as thorouglily as ^in tradition«il revj<»w«;. lU* contends that if the 
studies are not discussed, we are lorced to throw away the intormation 
we need to know as schplars m order to determine whether we should pay 
any attention to the findings. 

* A report of a qaantitative meta*analysi s must therefore* iti Itule . 
detailed description of tlie choiees made at eai h of the previou-^ five 
steps, a list oi the research which is in* luded in the data base an<I » 
discussion of at ie«ist some of the studi#*s inclurled in I he data Ka«^e. 
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\ KEnHKINITION f)>- MKTA-ANALYfilS 

While proponents ot quantitative meta-ana i i s *rjl't<'ize t^ 
«imit«itions of traditional narrative res<?arch r»viewr., the dl'^ u*. ^ 
of meta-analysis m this chapter has pointed *«t;t that it also n*. 
limitations as well as strengths. What propon«»nts ot meta-«i?^v " \ - > 
have often ignored is that narrative reviews have .t i nglh* \- P 



litni tat ions. ! inhL .md I'lllc-mer (1*J82) ari^ut- thiL qualttativi* 
intorxnatxon is t*qually as important ii> quantitative mtortnation tor 
♦•xpiaininj* contli* tinj» or puzzlinj* ouL*-om€*s *ind they discuss six ways 
in wtii*'h qualitative inlormation is essential in integrative research 
reviews: i) the iinjortauce ot dcu nment luf, the process aspects of each 
treatment as well as the statistical outcome and of documenting 
ditterent sub:»**ct >'.ri>ups who are . 11 a reflated together in the gam 
etiect scores but lor whom the treatments may have had dilfering 
outcomes; 2) the «.ontext in which a program operates is sometimes much 
more important than the test scores or outcomes ot the study; 3) 
qualitative intormation is needed when studies are aggregated across 
ditierent levels or units ot impact in order to understand the 
diiiering ettet ts at each level; h) subtle diifer-?nces often exist 
between treatments or control groups that ire supposedly the same and 
tneretore it is impurtan- to have a description of what actually 
happened * students m these groups in a study; >) sometimes the 
success ot a treatment is €*xpl*jined by features of the program apart 
iron: the original trec»,ment and qu^^litative data can provide clues to a 
ditterent teature ot ^he treatment that is more important than the 
original planned treatment; qual it.it i\e information Is important 

tor those who ise integrative rest-arcn reviews in making policy 
dec 1 s ions - 

Light and Pillemer (1982> maintain that research reviews need to be 
both quantitative and qualitative. They believe that qualitative 
reviews add the ciimensions ot contextual richness and quantitative 
reviews -idd <i way to systematic al ly look at a larger amount of data. 
Their proposal is that both quantitative and qualitative methods be 
used su. h that qiMnt it.it iv«« methods are used to detect differences and 
q::al ^ t*^t ive methf>c,^ ire used to t-xplain und evaluate those differences. 

reviews .ire or^'iniret to all> both torms ot information, they 
helieVf that this will !n.l^lx♦iy;e our knowledj^e about a particular area 
of research an^t r.ike thos#- reviews more iisefi^l to teachers and 
researchers. Th^* -i ^plexitv <>S * >irrent researt h plus the sheer numbers 
ot stunies make Muth tvpe». ot in:<>rm4itir»n • ruci^il to an understanding 
o2 any area ot siu^ty. 

This .hapter has pr^int<*d />ut the strengths ^nd limitations of 
nariative reviews .inr: quantitative meta-analysis through reviewing the 
literature on ^'arrattve reviews and meta-vmalysis and discussing our 
iiwn experien* «^ with .tillering the let hnique ot meta analysis. Based on 
the issues »:?*^. *i%sed It* this »-bapter» our researi'h team came to the 
same ,-on« lusii.n 1 i/.ht and IMllemer on the need for both quantitative 
and quail tat I'le rtvifvs i%t th«* research. 

Initiallv, we were 4<intent to retain the traditional definition o» 
met.*-anaU%« s «itu: all ft *>ne w-iv l»v syntht-M/e research which must 

''le sj|ppl*'m''i*te/jt bv i*lh*^r le.bn:qa«*s ol qualitative synthesis- However, 
it be* an»* iti rea .if^rlv ohv^ous that qt..«nt i tat i ve meta-analysis by 
itsell was nnt onH' :nadequat# an*: nmiT-illy uset»i1 but also misleading 
when divorced ? ron tbe qii*.l i tat i ve syntheses. Therefore, it seems 
important t i argue t*»r a redef imi 1 i«»n ot meta -analysis to include both 
quantitative and qualitative syiah*Nes to ensure that the two types of 
data and data ana1vsi«^ are alwavs interpreted and synthesized m 
, on.iunction with ea* r- other- I nlesn meta-analysis *s expanded to 
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include boLh qualitative and quantitative syntheses » some researv.hers 
will continue to only use the quantitative synthesis. Surveys of the 
landscape will be misleading and our journeys through the landscape 
will be unproductive. In fact, we may spend a ^reat deal of our time 
lost on that landscape because of a partial Jind mislcadmt^ survey oi 
the landscape. 

Another argument for redefining meta**analysis is found in the 
Oxford Dictionary defmtion of the prefix "meta." it refers to meta as 
meaning objective* systematic reflection and critical speculation and 
reflection- Defining meta-analysis as Class does only takes xnto 
account the first half of this definition while our proposed 
redefinition of roeta-analysxs allows for both the objective and 
systematic reflection through looking at gair effect scores and 
the critical speculative reflection through qualitative analysis of the 
studies • 

Meta-analysis is not an objective and rigorous technique to use m 
uncovering truth. We didn't arrive at truth in our meta-analysis but 
then neither docs other research. We found that, just as with all 
research* meta-analysis is a social construction that is limited by 
what we currently know and believe. It is important that we 
acknowledge this subjectivity rather than proceeding as if the use of 
numbers makes meta-analysis any more "objective" than the narrative 
reviews that Glass puts down as spe^ilation. However, just because we 
can't objectively aggregate information or people docs not mean that 
quantitative meta-analysis is not useful, especially when used In 
conjunction with qualitative meta-analysis. 



IMrLICATIOJCS FOR TFACHERS AND RESE.%RCHERS 

As readers of the roanv meta-analyses currently being published, 
both teachers and researchers need to view with skepticism those 
syntheses that only report mean gnin effect scores. As argued above, 
without knowing the context within which the studK'S were conducted, 
the information needed to determine the value of the findings is lost. 
Because of the "apples and oranges" issue^ it is difficult to know what 
a mean gain effect score means when one has no idea of the diversity of 
studies that that score represents. As mentioned earlier, we found the 
mean gain effect scores to be of limited usefulness except to look nt 
very broad categories and methodological variables and to indicate 
which categories needed closer examination. The reader of meta-analyses 
need to evaluate whether or not there has been an overrel*ance on 
quantitative synthesis without the support of the qualitative data* 
There also needs to be a complete description of decisions made at eath 
step of the meta-analysis. The derision, for example, of what studied 
to Include in the data base, can have a m*"ijor effe^^t on the findings 
and bias the findings depending on how that decision was made* 

Those who arc considering doing a meta-analysis need to look at 
the various issues raised in this chapter and de* ide how they will ile.il 
with them. We have argued here that those considering doing a meta- 
analysis need to expand their definition of meta-analysis to Include 
both quantitative and qualitative syntheses, "Hict. are simply too many 
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limitations involved m using only the quantitative analysis which 
llaits Its usexulncss m having* anything of significance to say to 
other researchers and teachers. 

Both readers and Msers of me t.x^ana lysis need to keep m mind that 
It IS not an objective means of uncovering truth. What meta-analysis 
does provide is a good state-of-the art of current beliefs m a 
particular area. It gives an excellent sense of what kind of research 
IS being done and where the limitations and holes are in that research. 
Those involved in meta-analysis gain an indepth base or theoretical 
frame for a more critical look at a particular area of study* It i) 
forces us to deal with what exists m a particular field and 2) points 
out directions for change. It 3) allows us to see relationships 
broader than the topic being looked at and 4) to reach conclusions about 
trends that are broader than the individual studies. 

Meta-analysis is not, however, a way to get at truth or facts. As 
one team member put it, we arrived at "consistent subjectivity" through 
^"oncensus. Meta-analysis is thus another way of knowing, another 
perspective on how to integrate a large body of research. However, the 
stress IS on meta-analysis as another way of knowing, not the only way 
of knowing. The debate on meta-«in«lysis is not on whether to use 
quantitative rather than qualitative reviews but on what new 
perspectives meta-analysis can offer to the process of integrating 
research m order to better understand where we currently are in a 
particular area of study. 

While meta-analysis gives an understanding of the set of current 
beliefs within a field of study, it does not encourage evaluation of 
those beliefs. Both reflection on current beliefs and evaluation of 
those beliefs «^re needed to move our fields of study along. Meta-- 
analysis IS not lakely to generate new sdeiis because of its emphasis on 
synthesizing what is already knovm and its positivistic search for 
^.ausal relationships. It does point us, however, toward directions for 
<:hanj*e based on a better understanding and an evaluation of what we 
currently belic^v*-. 

We have hctaro us a vast and partially charted landscape. Meta- 
analysis offers »js a way to go about surveying that landscape. Both 
the literature on meta-analysis and our experience with it as a tool 
for integrating renearrh findings indicate that to define it solely as 
a quant 1 tilt ive technique eliminates valuable information which is 
needed m order to give the findings meaning. If we w<int our surveys 
of the landscape to better reflect that landscape and to help us more 
productively continue our Journeys through that landscape, we must 
redefine meta-analysis to include both qualitative and quantitative 
syntheses; . 

As you continue reading the following chapters in this book, you 
VI 1) see how we have integrated both the qualitative and quantitative 
syntheses to support each other. In the following chapter. Row and 
Ifarste will give a more indepth look at the plans and procedures 
involved m the various stages of the meta-analysis, especially in data 
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*'oll<>ctioii and idenLitication and m data coding and analyis- in 
Chapter Rowc will focus in on the results of the quantitative ineta- 
analysxs using the five steps discussed in this chapter. She will 
discuss m more detail what we did m our meta*-analysis under each 
step, findings from the quantitative portion of the meta-analysis, and 
the strengths and limitations we found m quantitative meta-analysis. 



Chapter 2 



SURVEYING THE LANDSCAPES: 
PLANS AND PROCEDURES FOR THE RESEARCH 



Deborah Wells Rowe 
Jerome C. Harste 
Indiana University 



(NTRODUCTIGN 

Recently much attention has been directed to the state of education in our 
nation, and literacy, as a primary goal of schooling, has usually been in the 
limelight. Whether or not we accept the findings of reports v/hich claim that 
literacy in our nation is declining (e.g. A Nation at Risk ) or agree with other 
experts who contend that these statements are overly dramatic 
(Farr,Courtland, S.Beck, 1984), it is clear that among students labeled as 
^handicapped" learners, reading problems are a major factor In school 
difficulty. For those of us intimately involved with the teaching of reading, it 
is also apparent that the reading programs usually used with these students 
emphasize skills such as word identification and vocabulary but place less 
emphasis on promoting comprehension. Since ^making meaning" is what 
reading is all about, there is a need to somehow refocus our instruction lo 
help students improve their reading comprehension. 

In this chapter we will describe the federally funded research project 
which is being conducted at Indiana University with the goal of improving 
reading comprehension instruction for special learners. Specifically, the 
contract we have been working under for the last year requires that our 
research: 

• involve an analysis and synthesis of both basic and applied 
research, the examination of current school practices related 
to program development, and the discovery of approaches for 
improving instructional strategies and identifying teaching 
techniques for promoting reading comprehension with 
handicapped studients.' (RFP 83-025, 1984-65). 

The second phase of this two-year project, which involves observing reading 
comprehension instruction in classrooms serving handicapped students, is 
currently underway. But the first phase of this project, the meta-analysis of 
existing comprehension research, is already complete and serves a? the 
basis for each of the chapters In this book. Regardless of whether you are 
primarily interested in reading comprehension instruction as a classroom 
teacher, a teacher educator, or a reading researcher it Is Important that you 
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understand where and how we have gathered the information and formed the 
opinions expressed in Chapters 3 through 12. Our research expedition into 
the field of reading comprehension has surely been a highly personal 
experience, with each member of the team developing perspectives colored 
by the research paths we have chosen as well as the companions with whom 
we have traveled. Together, the chapters of this book form a kind of of 
travelogue of the experiences of our research team over the past year. Each 
author presents the team's consensus about what we have seen and come to 
understand^^but from his or her own unique vantage point In the process. 

The purpose of this chapter is to map the contours of this large and 
sometimes overwhelming research project. In order to do this we will 
present an overview of the completed meta-analysis as in Figure 1, and a 
kind of natural history of how the research was conducted. Basically, in this 
chapter we will address the "how" of this research, and leave the reporting 
and discussion of results to the chapters which follow. 

!t will soon become clear to you that our research path has not been a 
one-way trip from data collection, to data coding, to data analysis, to 
reporting our findings. Instead, these phases have often co-occurred, and 
we have often been forced to revisit already covered territory. This has 
required new decisions which have affected the rest of the mental trip we 
have taken as researchers. We feel this recursiveness has been a major 
strength of our study, but it does not make the reporting of the research 
process neat and easy. So in the sections which follow we hope to provide 
information about our decisions and procedures which will allow you to both 
understand the research process used In this meta-analysis, and to evaluate 
our conclusions in light of the strengths and weaknesses of the path we 
traveled in reaching them. To that end we will focus, in turn, on the four 
methodological issues which seem most crucial for understanding and 
evaluating a research synthesis: { 1 ) the overall plan of the research, (2) 
data identification and collection, (3) data coding, and (4) data analysis. 



OVERALL PLAN OF THE RESEARCH 

When we began this project our plan was to use quantitative meta-analysis to 
synthesize the results of those studies reporting appropriate data (means 
and standard deviations of treatment and control groups) and then to produce 
a more traditional narrative review of studies not amenable to quantitative 
meta-analysis. We naively assumed that a majority of the reading 
comprehension studies we located would fall into the former category. 
Therefore, we focused our attention fi. st on studies which could be included 
In the quantitative meta-analysis. Though the assumption proved to be 
faulty, in the present context this decision is important because it helps to 
explain why we sequenced our research tasks as we did, and provides a 
frame for understanding how the research progressed over time. 
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DATA iDENTIFICATtON AND COLLECTION 

We found that identifying, to say nothing of summarizing, what Is currently 
known about reading comprehension 15 not as straightforward a task as it may 
initially appear . Two immense problems were encounter ed. First, we had to 
identify everything that should be identified and then locate this information m 
published sources such as journals and books, and in unpublished sources 
such as dissertations and manuscripts solicted directly from researchers. 
Operatlonallzed, a review of this size means searching a variety of sources 
for candidate references, selecting those that arc truly appropriate (e.g. 
sorting reading comprehension articles from other types of reading 
articles), physically locating copies of these studies, and then sorting 
studies of reading comprehension instruction from psychological studies of 
reading processes where applications to practice are less clear. Supposing, 
of course, that we could adequately manage these tasks, a further phase 
would have to involve synthesizing this mass of information in some 
meaningful way. 

By consulting CARS, a master library indexing system which includes 
Books in Print , Dissertation Abstracts , Psychological Abstracts , FRfC 
holdings and other indexing systems, we discovered that some 37,000 
articles qualified as potential candidates to be included in a review of this 
sort. To make this task manageable we took a survival-of-the-fittest view 
and rationalized that ideas, tike species, would survive across time if and 
only If they were healthy. This position meant we concentrated our search on 
the last 10 years and included research older than this only if it was cited by 
at least 3 different authors, excluding an author citng his or her own work. 

A search by hand of 10 of the most important journals reporting 
reading research was done to check on the reliability of the CARS/ERIC 
system. ERIC seemed to include a wide variety of unpublished work, but 
listed only 37.5% of the published articles we had identified. Additionally, we 
checked the reference list of every pertinent article against our master 
bibliography, and then subjected any previously unidentified citations to the 
cycle of determination of relevance, location, and categorization. 
Conducting hand searches of major journals and examining the bibliographies 
of articles already selected for inclusion plus the use of ERIC printouts 
proved the most effective way to proceed given our purposes. 

In practice we reduced the 37,000 'reading' articles identified by ERIC 
to a subset of 5,000 for which "reading comprehension" was a descriptor. 
These articles were physically located, copied, and examined by a member of 
the research team. See Figure 1 for a visual display summarizing the data 
location and collection processes. 
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Whether or not we adequately covered journals which rarely publish 
reading research articles, like Elementary School Journal and Phi Delta 
Kappan Is not known. More problematic, even, is whether or not our 
bibliography includes research articles published as chapters m books rather 
than as articles--a practice which, incidentally, seems to be on the rise. 

A spot check of recent publications from the International Reading 
Association, the National Council of Teachers of English, Ablex, andErlbaum 
Suggested that we might miss up to 20% of the total number of articles which 
should have been h eluded. To reduce this possibility, we sent letters to all 
National Reading Conference and National Conference on Research in English 
members informing them of our project and requesting that they send copies 
of any articles they thought we might have difficulty locating. Since it is 
difficult to determine how effective this approach was, we present our 
current efforts arguing representativeness rather than inclusiveness. 
However, we do want to point out that while some studies may have escaped 
our search, we have exhausted all of the possibilities of which we are 
currently aware to locate research on reading comprehension produced 
during the last 10 years. 

Of the 5,000 articles we tentatively identified as dealing with reading 
comprehension, only 573 met our criteria as being actual research on 
reading comprehension. The remainder fell into two groups: (i) articles 
which expressed opinions and theories about reading comprehension but did 
not report research, and (2) reading research articles which did not really 
focus on comprehension. 

Of the 573 reading comprehension studies, only 137, about 24%, 
included sufficient statistical information (means and standard deviations of 
experimental and control groups) to be included in the quantitative portion of 
the meta-analysis. We are quite aware that the studies included in the 
quantitative meta-analysis a*^e nkely to differ m a number of ways from those 
synthesized narratively. For example, descriptive, ethnographic, and 
comparative studies (those comparing older and younger or more- and less- 
able readers) usually could not be included because they typically did not 
produce the needed statistical information. Also studies using qualitative 
measures, such as patterns of miscues or retellings, often were not 
amenable to quantitative meta-analysis. 

This stale of affairs, which we discovered only during the course of the 
study> has necessarily influenced the techniques which we have used to 
analyze the data. A quick glance at Figure 1 makes it clear that we have used 
qualitative meta-analysis techniques as a basis for the majority of the 
chapters in this book. This is not to minimize the interesting findings which 
we obtained through quantitative meta analysis, but instead to stale that we 
did not find this techniques as useful as we had initially hoped, both because 
it could not handle much of the existing research, and because it provided 
only the most general indicators of the effectiveness of instructional 
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techniques. The quantitative meta-analysis is discussed more thoroughly in 
Chapter 3. 



DATA coding: DEVELOPMENT AND USE OF THE TAXONOMY 

To summarize studies which represent a diverse range of methodological and 
theoretical oreientations, we needed a coding system which would allow us to 
reflect this diversity in an organized fashion. To decide which codes should 
be Included, we began by identifying major reviews in the field of reading. 
We chose these reviews based on their citation rates, starting this effort by 
building on the woric of Guthrie and his colleagues (1983). Our summaries of 
these reviews focused on key variables, or patterns of variables,, which the 
authors saw as important. To update Guthrit)'s lists we identified, via CARS, 
major reviews within the last 10 years. Much of this woric was contained in 
boolcs. No effort was made to read every review available. Rather, what we 
were looking for was a worlcing set of variables that represented the field and 
from which we could begin. 

When coding actually began, new studies frequently pushed the limits 
of the taxonomy, causing multiple additions and revisions. It is in the 
revision of the original taxonomy that the recursiveness of the meta-analysis 
process is most evident. It would have been impossible for us to devise, in 
advance, a taxonomy which would completely handle the existing data. 
Instead we found it necessary to allow new distinctions and categories to 
emerge from the data. An interrater reliability of .80 was set as a criterion 
level for purposes of deciding when a particular taxonomic category was 
adequately refined. Categories were explicated, defined, re^deflned, and 
expanded until this criterion was met. Of course, each time we made 
alterations in the taxonomy, previously coded studies needed to be 
reexamined to reflect these changes. In a research review of this size, the 
recoding became a tremendous taslc. Each change required a team member 
familiar with the taxonomy to reread and recode the previous studies as well 
as to make the corresponding corrections in the computer data base. For 
this reason, after about three months of developing the taxonomy through use 
we made the practical decision to use the existing codes without changes. Y/e 
completed the coding of the studies for the quantitative meta-analysis with 
this version of the taxonomy. 

Later when we began the qualitative synthesis of the remaining studios 
we did make a few more changes in the taxonomy. These were necessary to 
fine-tune categories which we had initially defined too broadly, and to add 
codes to handle groups of studies which were not reflected in the quantitative 
meta-analysis data base. Though important, these changes did not alter 
overall character of the taxonomy. In all, we fine-tuned the definition of 3 
subcategories, added 6 new subcategories, and deleted 3 categories which 
were infrequently used--making a total of 12 changes in a taxonomy which 
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contained 151 codes. The taxonomy which resulted from this final revision Is 
included oo Appendix A. It includco: 

(1) study information— (year of piihliration, number of 
comparisons, number of dependent variables); 

(2) subject ch aractenstics" (sex, race, income, achievement 
level in reading, grade level, handicapping condition, 
placement); 

(3) methodological characteristics— (sample size, duration of 
study, internal validity, and external validity); 

(4) experimental and control treatment descriptions— 
(materials used, linguistic unit featured, intent [examining 
basic psychological processes or testing Instructional 
treatments], and the specific text, reader, task, and cognitive 
processing factors involved); 

(5) dominant focus of the study — (text^ reader, task, and 
cognitive processing); and 

(6) characteristics of depe ndent measures— (kind, type, and 
level of linguistic unit tested, and internal consistency between 
the treatments and measures). 

In coding the characteristics of treatments, the taxonomy allows 
simultaneous recording of the aspects of the text, task, reader, and 
processing strategjes on which the researcher focuses. It also forces choice 
of one of these treatment characteristics as the dominant focus of the study. 

Not only did the taxonomy change somewhat over time, but the coding 
process Itself also changed as we became more consistent In our decisions 
about studies. During the Initial period of taxonomy development the entire 
team read and discussed the coding of studies as well as the needed changes 
In the coding system. After the taxonomy was stabilized and each of us had 
considerable experience in coding, only two team members actually read 
each study. By the end of the project, the research team achieved an 
intcrrater reliability of .92. For all practical purposes, the figure was even 
higher than this, because all studies were coded by two team members and 
differences were discussed and arbitrated by a third coder before data was 
entered into the quantitative meta-analysis data base. We estimate that it 
took us on the average 10 person hours to identify, locale, copy, catalog, 
select, read, double-code, arbitrate, and validate the coding of each article 
actually entered into our synthesis. 

Some simple calculation yields a figure of 1370 hours of work just to 
fully code the studies which contained data appropriate for the quantitative 
meta-analysis. There were times when we felt like those first cartographers 
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who traveled across our immense continent on foot-*over every new rise was 
an expanse of uncharted territory stretching as far as the eye could see. 
Though we slowly conquered the pile of studies for the quantitative meta- 
analysis It became Increasingly clear that the majority of studies did not fall 
Into this category* After the first eight months of the project, the coding of 
the 137 quantitative meta-analysis studies was almost complete, leaving, 
however, a tremendous amount of information uncategorized. 

At this point, the team assessed the likelihood of completing the coding 
of the remaining studies on all 28 variables and synthesizing this information 
before the end of the year — a deadline set in the original contract. We 
determined that limitations in resources and trained personnel would prevent 
the completeion of the coding, and would probably also interfere with our 
stated goal of synthesizing this body of research. Therefore, we decided to 
approach the remaining studies with an altered coding plan. We first 
determined that the information we needed most in order to complete the 
narrative reviews was the dominant focus code for each study. This code 
identifies the reader, text, task, or processing strategy subcategory which 
is the primary focus of each study. This information would enable us to 
group studies with related research hypotheses for the purposes of 
identifying the most heavily researched areas, and synthesizing studies with 
similar implications for instruction. 

Accordingly, we made an initial sort of the remaining studies based on 
a reading of their titles and abstracts. Team members were then assigned to 
carefully, but as quickly as possible, code only the dominant focus for each 
study. Table 1 represents one result of this effort by tabulating the dominant 
focus of all 537 reading comprehension studies by category. Readers 
interested in a full account of studies coded in each category are referred to 
the list of studies found under each hypothesis In Appendix B, and then to the 
complete bit liography in Appendix C. 

Through these procedures we have amassed a tremendous amount of 
information on reading comprehension research. To summarize, our data 
base Includes two sets of descriptive data: ( 1 ) a reliable coding for the 137 
quantitative meta-analysis studies on 28 methodolotiical and substantive 
variables* and (2) a tentative dominant focus coding for the 436 studies 
which had insufficient data to be included in the quantitative meta-analysis. 
Together these two data sets have permitted us to access groups of studies 
which address Important aspects of reading comprehension, and to 
synthesize them using quantitative and qualitative meta-analysis techniques. 



DATA ANALYSIS 

As indicated above, the data analysis phase of this study used two types of 
techniques: (I) quantitative meta-analysis as defined by Glass, McGaw, & 
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Tablel 



Frequency Oistrlbutlon of Studies 
by Oomlnont focus 



Code Oesciiptor 



TIHT 

101 

102 

103 

104 

105 

106 

107 

108 

109 

HQ 

111 

112 

113 



Qnonttty (length) 

Density of concepts/propositions) 
Repetition of Concepts 
EHpllcitnett 

Discourse Type (oKpotitonj) 
WhXtrt Intent 
$ynttctlc ComplBKity 
Semantic Repetltloeness 
Cohesion 

OrgenlzstlonQ! Structures 
Proposltlonol Structure (ortter) 
Physlcol Rppeoronce 
lllustrottons 



2 
13 
50 
20 

1 

2 
7 
3 

34 
16 
2 
13 
18 



Code Descriptor 



TBSK 

301 

302 

303 

304 

305 

306 

307 

308 

309 

310 

311 

312 

313 

314 

315 

316 



Letton Frameu;or1cs 
Time 

FunctlonQllty 

Teacher CKpectetlon/Behaulor 
Efferent (eKpetittri] teKt) 
aesthetic 

Indlulduollzed/lndependent 
Croup/SoclQf 

Situfitionoi (lorge school prxjgram) 
Cultural 

llngulitic (cloze/mcze) 

Rttitudlnal 

Perceptual/Motor 

ModfiUty 

Rate 

Reward 



29 
8 
1 

12 
• 

1 
6 
1 

25 
3 
7 
0 
7 
17 
4 



09 
3 
CL 
CO 

o 
o 
■o 

O 

0> 



fi» 
0) 

3 
CL 

■o 

o 
o 
o 

CL 

c 
n 
o 
o 



REROEft 

201 

20? 

203 

204 

205 

206 

207 

208 

209 

210 

211 



Reader Retponse/Perspectiue 25 

Schema fluallabillty (knowledge of content) 24 

Knowledge of SyntaH iq 

Knowledge of Genre is 

Learning style 15 

RItic-taking | 

flttltudo I 
fnlerost 

FleKlbility * 5 

Rppiy EHlstIng Strategies 4a 

RpplyKew Strategiet 27 



PROCESSING STRRTEGiES 

401 Recall 

402 Uiord Meanin3S 

405 Identifying Tent Stnictura 

406 inference 

407 Schema Construction 

408 Schema Maintenance 

409 Schema Selection 

410 Prediction 

41 1 Macro-aperatorc 

413 Transmadlatlon 

414 Rbductian 



23 
31 
10 
32 
4 
4 
2 
3 
13 
IS 
IS 
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Hfllc: The total number of categorlzco studies Is 573; 
howeoer, quantitotloe meto-analyiU studios with morD 
than one cMperlmental treatment receiued 0 dominant 
focus code for each treatment. Therefore, tome studies 
are represented more than once. 
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Smith (1981), and (2) more traditional qualitative meta- analysis techniques. 
A3 Figure I indicates, only ab-jut 25X of the data baoe was used in the 
quantitative meta-analysis, while the qualitative meta-analysis took the 
entire data base as Its domain. Because the procedures and results of the 
quantitative meta-analysis are discussed in detail in Chapter 3, we will turn 
our attention here to the qualitative meta-analysis. In the remainder of this 
section we will describe the analysis procedures which have led to the 
reports of results in Chapters 4 through 12. 

We followed two main paths as we approached the task of synthesizing 
information across the entire data base. After all the studies were coded by 
dominant focus, the frequency distribution of studies falling into each 
reader, text, task, and processing strategy category was examined. This 
Information Is displayed In Table 1. Beginning with this Information, our 
research team began to focus both on uncovering global patterns across •he 
entire data base (see Chapters 4 and 12), and on synthesis of specific 
information related to comprehension instruction (see Chapters 5 through 
ID. 

Another task which included elements of both global and specific 
synthesis was our effort to identify the major hypotheses which had been 
tested during the 10 year period covered by our data base. Using the date In 
Table 1 together with our own reading of who was doing what, and for what 
purposes, patterns began to emerge. For example, we found that similar 
hypotheses were sometimes tested for quite different reasons. One example 
is Wilhite's (1984) experiment where he tests the effect of pre-passage 
questions as cues to schema acttvatlorr an hypothesis which posits an active 
reader sampling from textual cues. This orientation is quite different from 
earlier studies by Rickards ( 1976) and his colleagues which were founded on 
the behavlorlstlc notion that adjunct questions could control readers' 
responses. This is only one of many instances where seemingly small 
differences in procedures can signal large differences in underlying 
assumptions. 

Appendix B positively states the major hypotheses that reading 
researchers make relative to instruction in reading comprehension for each 
of the text, reader, task, and processing strategy categories on our 
taxonomy. As mentioned above, relevant studies arc listed under each 
hypothesis and are identified by author and year as well as by data bank 
(quantitative or qualitative meta-analysis). Table 2 Identifies and labels the 
patterns we found in these hypotheses. 

Initial decisions on how to label the importance of each hy ^iothesis in 
reading comprehension research during the last ten years were made by 
Inspecting the frequency distribution of studies with a dominant focus in the 
corresponding categories. Codings, for the most part, reflect frequency 
though we did use the knowledge gained from reading these studies to temper 
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10! 
102 
103 
104 
105 
106 
10? 
108 
109 

no 
ni 

112 
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KoQDomlnant, Garrently Euoiuing 
KonOominsnl, Fulure Olrccliont H 

Sridglng ($) 



Code Hypothesis (jee BppendU a) 



P«Uem(s) 



Quonltlg (length) 

Denr5tg of concepls/iwoposUlons) 

fiepelltionofconceplt 

EKpilcIlness 

Discourse Type (eHpasllora) 
Ufritefs Intent 
Syntcctic CompleKlIy 

Semantic Repelltluencts 
Cohesion 

Orgonlz&llon&l Strac lares 
Propoiiljonal SInirture (order) 
Physical appearance 
Illustrations 
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> 
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Code Hypothesis (see flppendlK fl) 
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TBSK 

301 

302 

303 

304 

3GS 

306 

30? 

308 
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311 

312 

313 

314 

31S 

316 



Lesson FrameujQrts 
Tln^e 

Fonctionallty 

Teacher Expectatfon/Behaulor 
Efferent (eKposltorx; text) 
fiesthellc 

inflluiduaiized/indepandeni 
Sroup/Soclal 

SItuotionoi (larga school prDgram) 
Cultural ^ 
linguistic (cloze/tnaza) 
Bttltudlnal 

Perceptual/Motor 

Modality 

Hate 

fieioard 
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BENDER 

201 

202 

203 

204 

20S 

206 

20? 

208 

209 

210 

211 



Reader Response/Perspectlue « 
Schema RuallaWllty (knotaledge of content) > 
iCnoLuledyeof SyntoM 

rnooledgeofscnre v 
Learning 5tyte 

Bltk-teWng ^ 

Attitude ^ 

Intereil * 

FleHlblllly ^ 

Rpply EKisting Strateglts > 

BppfyKeui Strateglai > 



PBOCESSINSSTRRTIGIES 



401 
402 
<QS 
406 
407 
408 
409 
410 
411 
413 
414 



RacaJI 
Q7ord Meanings 
IdantsfyfngTeHl Stnjcttirv 
Inference 

Schema Construction 

Schema Malntensnce 

Schema Selection 

Prediction 

Mtcro-operatort 

Transmedlatlon 

tibductlon 
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the data when they 6\6 not reflect our reading of the current state of 
knowledge in the field. 

Some of the hypotheses listed in Table 2 and Appendix B have been 
coded Dominant , meaning they are the most frequently tested by researchers 
during the past decade. Others have been coded Nondominant. but Currently 
Eyolyina, meaning that quite recently key researchers in the field have begun 
exploring these hypotheses. This second set of hypotheses represents what 
some reading researchers, at least'', believe to be new directions. 

Still another set of hypotheses have been coded Nondominant, but 
Likely Future Directions. At the current moment there are few studies in 
these categories, yet they represent what we see as a shift in perspective, a 
new direction, an attempt to test the thinking of key theoreticians In the field. 
Together with the previous category these studies represent what the 
research team believes to be future trends in the field. 

A fourth set has been coded as Bridging , meaning that while these 
hypotheses are still being tested, they are rarely the dominant focus of 
studies. Because researchers test these hypotheses in a variety of ways, 
they are assigned to a number of different categories, given our coding 
scheme. The first type of Bridging hypothesis is illustrated by Hypothesis 105 
which deals with the use of content area materials in reading instruction. 
Only one study has been coded as having a dominant focus in this category; 
however, many studies make use otxontent area materials in the process of 
testing other hypotheses. This type of Bridging hypothesis seems to have 
achieved a taken-for-granted status in the field, that Is most researchers 
generally agree that students must be exposed to content area texts in 
addition to stories. An example of the second type of Bridging hypothesis is 
405. In this case, several coding categories reflect students' abilities to 
identify elements of text structure. Therefore, this hypothesis, written to 
correspond to processing strategy category 405, Is also supported by many 
studies coded in reader category 204 which deals with knowledge of text 
structure. While these studies were originally separated depending upon 
whether the researcher focused on the reader's existing knowledge or the 
process of using that knowledge, there is an important relationship between 
the categories which we are noting by the use of the Bridging designation. 

A fifth set, essentially uncoded in Table 2 and Appendix B represents 
hypotheses being tested, but neither dominant nor abandoned. Many of these 
hypotheses represent the thinking of the preceding decade. In some 
instances they were found wanting. Typically they represent hypotheses 
believed not to be as fruitful for advancing the field at this moment in our 
intellectual history. 

Dominant and Bridging categories represent ^normal science* during 
the last decade. NonDominant categories signal a 'paradigm shift.* By 
contr^asting Dominant and NonDominant categories and by identifying the 
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assumpUons underlying these categor jes the characteristics of this paradigm 
ohift con be sketched. Chopter 12 oddreooec thJo contention thot o porodigm 
Shift is occurring in the area of reading comprehension research- 
While identifying and tracking the hypotheses that researchers are 
testing in the name of reading comprehension is interesting and important m 
its own right, it falls short of providing answers to teachers' questions about 
methods for improving reading comprehension instruction. For this reason, 
we have produced, through qualitative analysis, specific reviews of the 
literature pertaining to comprehension instruction in a number of important 
areas such as special education , critical reading, background knowledge, 
and comprehension assessment. Since it became increasingly clear that 
individual team members had already developed considerable knowledge 
about particular portions of the data base over the course of the project, 
decisions about which topics should be chosen for in-depth analysis and 
synthesis were based both on these interests and on our desire to cover a 
wide range of topics. 

From this point we proceeded to read or reread each of the studies 
coded in categories related to our topics. After much in-process 
discussion about the conclusions we were forming, we produced a series of 
synthesis papers which have served as the basis for this volume. To see the 
scope and thesis of each of these syntheses we refer you to the chapters 
which follow. 



CONCLUSION 

In this chapter we have described the design of a project funded by the 
federal government to review the research on reading comprehension 
instruction for special learners. Here we have focused only on the first 
three components of the process: data location and collection, data coding, 
and data analysis. Yet to be described are the results of the quantitative and 
qualitative portions of the meta-anaiysis. While we realize that our efforts 
to date represent only a few of the possible perspectives from which this 
large data base could be synthesized. It Is the purpose of the remaining 
chapters of thia volume to present our current view of reading 
comprehension research and what we see as implications for improving 
Instruction. 



PART II: QUAKTITATIVE META-ANALYSIS 

FINDINGS 



er|c 
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Chapter 3 



THE BIG picture: 
A QUANTITATIVE META-ANALYSIS OF 
READING COMPREHENSION RESEARCH 

Deborah WeUs Rowe 
Indiana University 



INTRODUCTION 



Over the past several decades research concerning reading processes and 
reading instruction has increased dramatically. This is evidenced by the 
growing number of professional journals that are primarily devoted to the 
publication of reading research. This has made the production of Integrative 
reviews a necessity, but with the increased pace of investigation the task of 
synthesizing the mass of findings from these studies has grown more 
difficult. However, It Is not simply the quantity of research which presents 
problems for would-be synthesizers. They also face the important decisions 
of aUliill studies to include, andliiiatthe findings of these studies should be 
evaluated, compared, and weighted. 

The quantitative meta-analysis technique proposed by Glass, McGaw, & 
Smith (1981) is one approach to the problem of research synthesis. Since it is 
this type of meta-analysis which will be discussed in this chapter, a brief 
description of this technique is in order. In quantitative meta-analysis the 
summary statistics reported for each study become the unit of analysis and are 
transformed into a common metric allowing direct comparison between studies. 
Smiths Glass (1977) define this measure, the effect size, as the difference 
between the means of the experimental and control group, divided by the control 
group standard deviation. Because studies often make more than one 
compariijon between an experimental and control group, It is also common for a 
single study to produce a number of effect size scores. How effect sizes should 
be further analyzed is a matter of debate. Glass ( 1977) has suggested that 
meta-analysis ought to fulfill primarily descriptive purposes even though it is 
possible to use gain effects as a basis for traditional inferential statistical 
tests. Since he views the major purpose of meta analysis as providing general 
conclusions for an entire area of study. Glass typically has used the average 
effect sizes generated for broad categories of studies to describe the relative 
effects of various types of experimental interventions. This and many other 
facets of quantitative meta analysis are currently under heateti debate within the 
educational profession. (The entire October, 1984 issue of EducbUonal 
Researcher was devoted to meta-analysis. ) \ 
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It is not my Intent fn this paper to address all of the methodological 
uncertainties of quantitative meta analysis. These issues have been discussed 
in Chapter 1 . Instead my purpose is to report on the procedures and results of 
the portion of our research project which used this technique to synthesize the 
literature on reading comprehension. Accordingly, my first aim is to present a 
picture of reading comprehension research (from 1974 to 1984) as seen through 
the lens of quantitative meta-analysis. Since it will become clear in my 
discussion that I feel the technique has been more useful for focusing on some 
types of research questions than others, a second dim of this chapter Is to point 
out where quantitative meta-analysis has been most helpful and mo'.t limiting. 

True to Glass' vision of the purpose of meta-analysis, the findings I will 
report will produce a picture which is little more than a general outline of 
factors which influence reading comprehension. Only as our team has combined 
quantitative and qualitative meta analysis techniques has the image become 
sharp enough for us to have confidence in our conclusions. We have also found 
that looKing at the entire data base, including those studies which were not 
amenable to quantitative meta-analysis, has caused us to take a different 
perspective on the scene and to see new trends and relations which were not 
evident m the initial profile of reading comprehension presented by quantitative 
meta-analysis. 

Contrary to much that we read before beginning the project, we did not 
experience meta analysis as a linear process moving smoothly from problem 
formulation, to data collection, to data evaluation, to data analysis and 
Interpretation, and finally to the presentation of results (Cooper, 1982). 
Instead, we found It necessary to revise early decisions In light of subsequent 
insights. And now, after more than a year of work on this project, wc recognize 
ways m which the coding of our data base could be revised to reflect our current 
understandings about reading compi ehenslon research. Having said this, it 
still seems useful to organize this discussion m terms of the stages mentioned 
above: ( I) problem formulation, (2) data collection, (3) data coding and 
evaluation, and (4) data analysis and interpretation. The first three stages of 
this meta-analysis have been described m detail m Chapter 2, so I will discuss 
them only briefly here. For more details readers may want to review parts of 
that chapter. I will discuss m depth, however, the major decisions made by our 
research team, some of the major points at which the meta-analysis process 
became recursive, and the major findings which have emerged. As a note to my 
readers, in the remainder of the chapter 1 will use the term 'meta-analysis* to 
refer to the quantitative meta analysis technique decnbed above (Glass, McGaw, 
&Smith, 1981), unless otherwise specified. 

PROBLEM FORMULATION 

The formulation of the problem for this meta-analysis grew directly out of 
the requirements of the federal contract which funded the research. 
According to the contract, the purpose of the first part of the project was to 
analyze and synthesize both basic and applied research relating to reading 
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comprehension in order to make recommendations for improving the reading 
comprehension skills of hondicoppcd students. Both quontitovc mcto- 
analysis and traditional qualitative research review techniques have been 
used by our team to address this problem. 

One aspect of problem formulation involves defining the construct 
"reading comprehension*. While many investigators clearly state that they are 
studying some aspect of comprehension, they often fail to define this term, and 
it is evident from the variety of tasks and approaches used that they are not 
entirely in agreement about what constitutes comprehension. Because Glaso and 
his colleagues ( Glass, McGaw, & Smith, 1981) believe that meta-analysis is 
especially appropriate for drawing generalizations from broadly defined 
domains, we adopted a rather lenient criterion for defining reading 
comprehension. In order to represent the variety within the field as much as 
possible, we made the operational decision to include in our data base any 
reading research study with some focus on the meaning of text, or which used a 
dependent measure which met this condition. 



DATA COLLECTION 

One of the most crucial aspects of any integrative review involves the 
location and collection of research relevant to the problem under study. It 
is at this point that bias can either intentionally or unintentionally be most 
easily introduced into the review (Glass, 1977). Considerable attention has 
also been given to the possibility that published studies may have a positive 
bias because of the tendencies of editors and reviewers to accept articles 
reporting statistically significant findings (Glass, McGaw, & Smith, 1981). 
Thus, Glass and his colleagues stress the importance of making a concerted 
effort to find aJi research on the topic by searching the indexes of both 
published and unpublished studies. Only with such a concerted effort can 
valid generalizations be made about the area. 

We were in strong agreement with these recommendations, and set as our 
goal the location of all reading comprehension studies, published or 
unpublished, during the 10 year period from 1974 to 1984. While we recognized 
this task to be enormous in its scope, we definitely underestimated its 
complexity. In fact, this was true to such an extent that it necessitated the 
hiring of a additional (and unbudgeted) staff member to coordinate the literature 
search. 

Initially we began with a computerized search of CARS, a master library 
indexing system which includes Books in Print . Dissertation Abstracts . 
PsvcholoQical Abstracts , and other indexing systems. We initially identified 
37,000 articles as potential candidates for this review, but finally limited the 
field to 5,000 which were accessed using "reading comprehension* as a 
descriptor. Because & hand search of important reading research journals 
Indicated that the CARS/ERIC system was only locating 37.5% of the articles we 
had Identified independently, we decided to continue to preview selected 
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Journals. We also sent letters to the members of the National Reading 
Conference and the National Conference on Research tn English requesting copies 
of in-process, or unpublished research, or any work Ihey thought we might have 
trouble locating. 

Our other approach to the problem of locating all reading comprehension 
research between 1974 and 1984 was to cross-reference the bibliography of 
every article identified for inclusion in the meta-analysis. We then submitted 
any previously unidentified citatlons-to the cycle-.of deter^mlnatIoa.of relevance,, 
location, and categorization. 

After closer examination of the articles themselves, 573 studies were 
classified as reading comprehension research. Of the 573 reading 
compreheiiSion studies, only 137 reported sufficient statistical information 
(means and standard deviations of experimental and control groups) to be 
included in the meta-analysis. While we are sure that some studies, both 
published and unpublished have somehow escaped our attention, we have 
nevertheless exhausted all the possibilities of which we are currently aware 
to locate research on reading comprehension produced during the last 10 
years. 



DATA CODING AND EVALUATION 
Coding Decisions 

In line with the recommendations of Glass and his colleagues (1981) we made 
the decision to include all studies which provided sufficient data and met our 
operational definition of reading comprehension. We chose not to elirT^inate 
studies because of flawed research designs . According to Class, this 
prevents bias which might result from the imposition of arbitrary, 
nonempirical criteria for research quality. From his perspective, the 
evaluation of the effects of study quality should not be an a priori 
determination, but should instead be made empirically by examining the 
relation of methodological variables to the meta-analysis results. This 
allows the researcher to determine whether different patterns of results 
were produced by good and poor quality studies. If no such difference exists. 
Glass suggests that there Is no redson to delete the Important descriptive 
information included in these studies. 

In the introduction I presented a brief description of the statistical 
technique of meta-analysis including the use of effect sizes as the dependent 
variable. In the context of the present discussion it Is important to 
understand that studies are also coded on a variety of substantive and 
methodological characteristics which become the independent variables of the 
meta-analysis (Glass, McGaw, &Smith, 1981). Substantive features are 
directly related to the problem under study. Those coded in our study were: 
(1) sex, (2) race, (3) income, (4) achievement level m reading, (5) grade 
level, (6) handicapping condition, (7) clasr, placement, (8) text factors, (9) 
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reader characteristics, (10) task characteristics, (11) processing 
Mrotegie5, (12) dominant focus of the study, (13) linguistic unit, and (H) 
materials. Methodolooical features, on the other hand, are the general 
characteristics of the research designs employed In the studies, such as: ( 1 ) 
date of the study, (2) number of treatment/control comparisons, (3) number 
of dependent measures, (4) sample size, (5) duration, (6) external 
validity, (7) treatment personnel, (8) internal validity, (9) type of control 
group data, (10) internal consistency of treatments and dependent 
measures, (11) kind of dependent measure (e.g. comprehension questions), 
(12) type of dependent measure (e.g. standardized), (13) linguistic unit of 
dependent measure, and (14) instructional focus. These latter 
characteristics are the same ones used to evaluate the reliability and validity 
of any research design. 

In order to specify which features should be coded for each study, we 
developed a taxonomy which included the 28 variables listed above. The form 
of the taxonomy which appears fn Appendix A is the latest in a long line of 
drafts and revisions which became necessary over the course of the study as 
we attempted to code new studies. Each time we refined the taxonomy, 
previously coded studies needed to be reexamined to reflect these changes. 
In a research review of this size, receding has been a tremendous task 
requiring rereading, receding, and then reentering the Information In the 
computer data base. 

As we have continued to synthesize the literature using qualitative 
techniques, we have made additional changes in the taxonomy so that the 
current form now reflects an even broader view of reading comprehension 
research. We have not, however, had the resources or time to completely 
revise the coding of the 137 studies included in the quantitative meta-analysis 
to reflect these changes. For this reason we feel that some of the Initial 
results of the quantitative meta-analysis are flawed. In the data analysis 
section , I will discuss the areas where we now feel the taxonomy categories 
used during the quantitative meta-analysis were weak, and examine the effect 
of this state of affairs on the results. 

Validity and Reliability of Methodological Decisions 

While the taxonomy provides categories which can be used to evaluate 
studies in the meta-analysis methodologically, the research procedures used 
by our team are themselves subject to validity and reliability checks. Glass, 
McGaw, & Smith ( 1981 ) list as validity considerations the clarity of 
definitions, the adequacy of information reported m located studies, and the 
degree of inference required to determme the characteristics of the studies 
from the written research reports . With regard to the clarity of definitions 
for variables used In our taxonomy, I have already alluded to the changing 
nature of some aspects of the taxonomy. However, the fact that these 
changes were necessary indicated both that the origimal defintions were 
Inadequate to describe the data, and that our meta-analysis procedure was 
flexible enough to allow movement toward definitions which fit the data more 
closely. Because of the emergent nature of the taxonomy, we feel that we 
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have reached at least one valid representation of the reading comprehension 
research conducted from 1974 to 1984. 

The second and third considerations pose more serious threats to the 
validity of the results of our meta-analysis. As mentioned earlier, only 23% 
of the reading comprehension studies In our data base reported enough data 
to be for included in the meta-analysis (i.e., means and standard deviations 
of the control and experimental groups). This has caused us to seriously 
consider the posslbfUty that the studies Included were somehow different In 
nature from those which were not. After examination of the studies with 
insufficient data, we have concluded that this hypothesis is at least partially 
correct. We have found that some of our taxonomy categories were 
underrepresented in the meta-analysis, and also that some new categories 
were necessary to accommodate the studies with Insufficient data. Overall 
reading comprehension studies which were not amenable to meta-analysis 
Included: (1) studies which used inferential or correlational statistics and 
reported only F and t ratios or correlation coefficients, (2) descriptive or 
ethnographic studies in which treatments were not compared, and (3) 
comparative studies which contrasted characteristics of subjects (e.g. 
good/poor readers, older/younger students) rather than treatments. Here 
we should note that formulae which estimate effect sizes from a variety of 
Inferential and correlational statistics are available (Glass, McGaw, & 
Smith, 1981 ); however we have chosen not to use these techniques since they 
are yet to be proven and remain controversial. Thus, we feel it is important 
to present the results of this meta-analysis with the caution that it is likely 
that they do not fully represent the entire data base of 573 studies. This has 
been one of our main considerations In supplementing the findings presented 
below with extensive use of qualitative reviews to provide a more 
comprehensive view of the field - 

The third validity considefvatlon, the extent to which coders must infer 
study characteristics from the written reports is also a threat to this meta- 
analysis. We found it difficult to make the kinds of distinctions demanded by 
our taxonomy, given the brief descriptions provided in most reports. This 
seemed to be heavily Influenced by the editorial policies of the publishing 
journals, as we uniformly found some source publications to provide more 
adequate information than others. Interestingly, we found unpublished 
dissertations and technical reports to be some of the most complete sources 
of information about experimental treatments because of their extended 
discussions of research projects. In short, we were forced in many cases to 
infer characteristics of the studies included in the meta-analysis, and thus 
we may have incorrectly represented them in some ways. 

However, it must be said in the context of this discussion that our 
meta-analysis suffers no more or less from these last two validity 
consideratiofis than does any traditional review of the literature. These are 
difficulties which have been noted by most researchers attempting thorough 
integrative reviews, whether they have used narrative techniques or meta- 
analysis. 
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We also feel that the development of the detailed taxonomy is a special 
strength of thia atudy ond odda to the volidity of our findings. The use of o 
taxomony which requires systematic evaluation of both methodological and 
substantive features ensures that each study has been thoroughly exammed, 
and that the meta-analysis team has made a strong effort to understand the 
purposes, procedures, and results of all studies regardless of theoretical 
or methodological harmony with our own beliefs. 

We have also evaluated the reliability of our meta-analysis by checking 
the inter-rater reliability of our coders at various points in the process. We 
found that inter-rater reliability coefficients was .92 by the end of the 
study. This simply means that the team members reached a high degree of 
social consensus about the manner in which information given in research 
reports should be coded. We continued to support the reliability of this 
process by having at least two team members read and code each study, with 
provisions for appeal to the entire group to resolve important disagreements 
if necessary. Given the complicated nature of the judgments which were 
required in order to code each study, we maintained a high degree of 
consistency. This agreement was developed by hours of group discussion 
during the initial development of the taxonomy and was refined through use. 
While our experience of trying to train new team members in the coding 
procedures have made it clear thai newcomers cannot immediately make the 
same decisions as experienced coders, we do suggest that the meta-analysis 
coding reflects a consistent view of the data, albeit a socially constructed 
one. 

Summary 

To summarize, we feel after examining the methodology used in this 
meta-analysis that the results reflect reliable methods, but that the validity 
of the findings is limited by the characteristics of the research reports which 
formed the raw data for this study. This includes the lack of detailed 
description within studies, and the fact that the almost 75% of *he located 
studies did not contain the statistical information necessary fcr quantitative 
meta-analysis. Still, any integrative review which ^/estr ibes well over 100 
studies on 28 different variables is worthy of attention by those interested in 
research in the area of reading comprehension. 
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DATA ANALYSIS AND INTERPRETATION 

The findings of this meta-analysis fall into two major categories. The first 
group of findings are related to methodoloQical questions, and the second to 
substantive ones. Generalizations about the substantive issues related to 
reading comprehension can be further subdivided into statements related to 
characteristics of students and Instruction , In each case the meta-analysis 
yields descriptive data of two sorts. First, it provides information on the 
frequency with which any particular level of a variable occurred in this data 
set, and second it provides a measure of the average effect size associated 
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with that variable. Afier a presentation of some summary statistics on the 
the entire data set, I will deal with methodological and substantive findings in 
turn. 

Overall Results 

In earlier sections of this paper, I mentioned that the data for this 
meta-analysis contained effect sizes calculated from a total of 137 reading 
comprehension research reports. I also briefly explained that in meta- 
analysis more than one effect size may be derived from each study if several 
treatment and control group comparisons are made, or if the study uses a 
factorial design to address several research questions. At least one effect 
size is generated for each comparison or question. The total number of 
effect sizes In our study was 1537, and the contribution of single studies 
ranged from 1 to 60 effect sizes, with an average of 1 1 .2 per study. While 
we are aware that multiple effect sizes generated from a single study are 
nonindependent, we chose to follow Glass" procedures which suggest that 
meta-analysis is robust to such problems (Glass, 1977). 

The entire data set can also be described in terms of the grand mean of 
the effect sizes scores. We found that the mean effect size (Mes) of 
experimental groups compared to control groups was .70 (standard 
deviation= 1.73). This indicates that on the average students receiving an 
experimental treatment gained .7 of a standard deviation (SDes) more than 
controls who did not receive these treatments. To illustrate the approximate 
interpretation of this overall mean effect size. Figure 1 presents the 
distribution of scores for the control and experimental groups as two normal 
distributions. Assuming normality, the effect of experimental treatment was 
to make these students perform better than 76% of the control students on 
reading comprehension measures. Thus, it appears that on the average, the 
experimental treatments used in these studies were quite effective in 
Improving reading comprehension. 

We have chosen to present only descriptive data here and in the 
remainder of this discussion for the following reasons. First, if Glass ( 1977) 
IS correct, it is likely that even small differences between mean effect sizes 
would be statistically significant given the large number of subjects InvoVed 
in each comparison. Significance teats would yield little information 
concerning the practical importance of such differences. Secondly, as 
Landman and Dawes (1982) point out, the sampling distributions for 
inferential statistics in meta-analysis are yet to be evaluated, making the 
use of the usual inferential tests speculative at best. One informal criterion 
adopted by Landman & Dawes (following Smith, 1980) is to consider effect 
sizes reliably different only if they are more than two standard errors apart 
(SE of Mess SDes t the square root of N). In order to permit readers to make 
these informal evaluations, the number of effect sizes, the percentage of the 
total effect sizes, the average effect size, and the standard deviation of the 
effect sizes, are reported in the tables which accompany this paper. 
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AVERAGE EFFECT OF EXPERIMENTAL 
TREATMENTS 



0.70^^ 




T \ 

50lh Percentile of 76ih Percentile of 

Control Group Control Group 



Number of Studies = 137 

Number of Effect Size (ES) Scores - 1537 

Average Number ES per Stuoy = 11,2- 

Average Effect SiZ2 = ,70 (SD=1,73) 
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Methodoloofcal FindirKis 

Research Design 

At the outset one of the most important questions to be answered 
empirically Is whether the quality of studies Included In the meta-analysis 
affected the average gain effect scores. As you can see in Table 1 , effect 
size scores from studies with low internal validity were almost twice as 
large as those coded as high in internal validity. Thus, there does seem to 
be evidence that study quality effects the average gain effect scores. 
However, It Is also Important to note that the grand mean of the effect size is 
much more similar to the high internal validity subcategory, than to the mean 
effect size for the low internal validity category. So the effect of including 
the smaller group of flawed studies (22.52) seems largely offset by the 
greater numbers of good studies (77.42). 

One problem which arose frequently in our meta-analysis was the lack 
of true control groups. Meta-analysis is based on the notion that 
standardizing each experimental group's score according to the control 
group's standard deviation will create a common metric. However, when 
control groups vary widely, experimental groups are necessarily being 
standardized differently. In our study researchers included a clearly 
identified control group only about half of the time. This situation often 
required us to choose one of the treatments to serve as the control 
computation of an effect size. While we find this a serious problem for data 
interpretation, the mean effect sizes for experimenter-assigned and coder- 
assigned control groups were .54 and .74 respectively. Using the Informal 
criterion of two standard errors, these means do not differ reliably from one 
another as listed in Table 1. It seems that whether the original investigators 
or our team members designated a treatment as the control group the mean 
gain effect was about the same. This is an expected outcome of our coding 
procedure since we made control group designations by carefully reading the 
research reports to determine which treatments had been included to test 
important hypotheses and which were included mainly for comparison 
purposes. 

Another variable which was of considerable Interest to us was the 
relative percentages of "basic* and 'inslruclional* research studies in the 
data base. We should note that this distinction seemed clear at the outset of 
the project, •)ut became Increasingly fuzzy as we tried to code real studies. 
However, our operational decision was to designate a study as 'instructional" 
if researchers were testing the effects of an instructional technique which 
they would suggest for adoption in classrooms without modifications. The 
percentages of direct instruction (442) and non- instructional effect size 
scores (442) was for all practical purposes the same, with relatively minor 
differences in the mean effect size for these two categories. If our data base 
is at all representative of the whole of reading comprehension research 
during the last ten years, it seems that there has been a rather balanced 
effort to investigate the cognitive processes, involved in reading and the 
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Table 1 

Hethodologicai Findings 



The avereoe readfno com prehension srnriv VfiHahlft h' 1 SQes^ 
in our data base: 



1. HAS HIGH INTERHAL VALIDITY 

♦Studies with low Internal Validity 
have higher Hoc- 



3. INVESTIGATES BASIC PROCESSES OR 
DIRECT INSTRUCTION 

♦Mg3 is similar for basic and 

applied research. 

4. LASTS 1 WEEK OR LESS 
♦Studies with short duration have 

higher M^s. 



High I. V. 1190 77X .58 1.2 
Lowl.V. 347 23X 1.11 2.85 



51% .64 1.42 
AQX .74 1.98 



Dir. Inst. 669 442 .74 2.12 
Basic Res. 579 44Z .62 1.37 



Iweek 980 54X .83 2.0 



2. MAY OR MAY NOT HAVE A TRUE CONTROL Control Gr. 770 
GROUP Assigned CG 757 

♦Mgg Is similar for studies with and 

without true control groups. 



5. HAS A TREATMENT CONDUCTED BY THE Researcher 1297 84X .74 1.79 
RESEARCHER Teacher 140 9% .65 1.42 

♦Mgg is similar whether the teacher 

or researcher administers the 
treatment. 



6. HAS A SAMPLE SIZE OF MORE THAN 50 0-50 555 43X 

50 or more 882 57X 



N= number of effect size scores, 
^es" fncan effect size score. 
'SDg3= standard deviation of effect size scores. 
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instructional techniques which are most effective In faciliating 
comprehension. 

Duration of the study is another methodological feature which 
influences the average effect size obtained. Over half (63. 8X) the gain 
effects were produced by studies lasting one week or less, with another 30Z 
lasting from two to nine weeks. As indicated in Table 1 , the studies with the 
shortest duration, 1 week or less, had an average effect size of .83, while 
the two to nine week studies had an average effect size of .50, We might 
hypothesize that shorter studies benefitted more from the Hawthorne Effect 
than did longer studies in which students had time to adjust to the novelty of 
participation in an experiment. It is also possible that longer studies may 
have presented more complex treatments leading to a mors global match 
between the treatment and outcome measure, which as discussed below, also 
affects average effect sizes. 

An encouraging trend related to duration is apparent when numbers of 
effect sizes from studies lasting more than one week are plotted against the 
date of the study. Figure 2 graphically Illustrates this jagged but increasing 
trend in the percentage of gain effects derived from studies lasting more than 
one week. This is especially interesting since most descriptive and 
ethnographic studies, which are typically of longer duration, are not Included 
in the meta-analysis. It is likely that this trend reflects researchers* 
mcreasing awareness of the complexity of the classroom environment and the 
importance of ecological validity for studies designed to make 
recommendations about instructional practice. 

While more studies are beginning to cover longer periods of time, wa 
found that the researcher still administers the experimental treatn^cni in 
MAX of the cases. The regular classroom teacher delivered the 
experimental treatment only 9. 1% of the time. Our results, shown in Table 
1, indicate only small differences in the average gain effects of these two 
subgroups. This finding could be interpreted in two ways. First, we might 
suggest that the researcher has the same effect on the results of the 
treatment as does the students' regular teacher, but conversely we might 
also stress that the teacher's direct participation had no adverse effects on 
the outcome of the experimental interventions. This may indicate that 
researchers should be considering more collaborative research in which 
regular classroom teachers become a part of the research team. 

Another promising finding is that 57. 4X of effect sizes were based on 
sample sizes of more than SO students, and only 15.6% were based on studies 
with 25 or fewer students. Larger sample sizes should theoretically add to 
the stability of reading comprehension results, decrease the likelihood of 
drawing extremely biased samples, and increase the chances of finding 
significant differences if they exist. 

Summarv orofile. To summarize our findings thus far, we are building 
a profile of an average reading comprehension study which has high internal 
validity, lasts less than one week, uses a sample of more than 50 students. 
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has an experimental treatment administered by the investigator, and which 
may or may not contain c true control group. This average study la equally 
as likely to investigate the cognitive processes used in reading as reading 
instruction. Moreover, studies of short duration and low internal validity 
have been shown to yield higher average effect sizes. 

Dependent Measures 

A final group of methodological variables provides information on the 
effects of dependent measures. First, wa find that most effect size scores 
come from studies using more than one dependent measure. In fact, only 
6.5% came from studies using a single outcome measure. Second, Table 2 
indicates that 501 of the time the dependent measure was some form of 
reading comprehension questions. Together, retellings and vocabulary tests 
accounted for another 30% of the outcome measures. V/hen the average 
effect sizes are examined for each of these categories, vocabulary tests 
result in more than twice the mean gain effect obtained by using reading 
comprehension questions (1.77 and .70 respectively). Retellings result in 
slightly lower (.50) mean effect sizes. A simple Interpretation of these 
results indicates that the more specific and structured the outcome measure, 
the higher the effect size . It seems to be the case that certain types of 
outcome measures are usually linked closely with the type of Instruction 
provided. For example, this seems to be especially true for vocabulary 
instruction where the outcome measures were almost always vocabulary 
tests. 

The findings just reported are also consistent with our observations of 
a generally decreasing trend for mean effect sizes as the linguistic unit used 
in the dependent measure increases. Evidence of this is shown in Table 2. 
The mean effect size obtained for measures using words as the largest unit of 
text (Mes=1.28) was twice as large as when whole texts were used 
(Mes=.62). Dependent measures using whole texts were the most frequent, 
followed by those using multiple unrelated paragraphs and single 
paragraphs. A similar pattern for the texts used in experimental treatments 
will be discussed in the section of this chapter on substantive findings. 

Two other features of the dependent measures which produced 
differential effects on our meta-analysis results are the type of measure 
(standardized or non-standardized) and the degree of mternal consistency 
between the treatment and the outcome measure. We found that only 5% of 
the gain effects involved the use of standardized tests and that this small 
subcategory had less than half the mean effect size produced by non* 
standardized measures (.30 and .72 respectively). This is particularly 
ironic since Glass (1976) specifically points to the standardization of 
outcome measures as one characteristic of reading comprehension research 
which makes it especially suited to meta-analysis. While informal 
observation suggests that standardized tests are widely used in school 
settings, this Is not the case for most of the reading comprehension research 
included in this data base. 
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Table 2 

Methodological Findings: 
Dependent Measures 



The averaqe reedina comorehension 
study in our data base: 


Variable 




X 


M 2 




1 . USES MORE THAN 1 DEPENDENT MEASURE 


1 dep. ms. 
More than 1 


100 
1407 


7% 
922 






2. USES COMPREHENSION QUESTIONS AS THE Vocab. Tests 103 
DEPENDENT MEASURE Comp. Q's 772 

Retellings 336 

*More structured dependent measures 
produce higher M^g. 


7% 
50% 
24X 


1.77 
.70 
.50 


4.5 . 

1.3 

1.2 


3. USES NON-STANDARDIZED MEASURES 

*Non--standardized measures produce 
higher M^g. 


Non-Stand. 
Stand. 


1460 
77 


95X 
SX 


.72 
.30 


1.75 
.83 


4. USES DEPENDENT MEASURES WHICH 
CONTAIN WHOLE TEXTS. 

^Dependent measures which focus 
on smaller linguistic units have 
higher M^g. 


Sentence 
Paragraph 
Multiple qs 
Texts 


59 
193 
482 
605 


AX 
13Z 
31Z 
45X 


1. 51 
1.04 
.45 
.63 


3.45 
2.02 
.88 
1.25 


5. HAS HIGH INTERNAL CONSISTENCY High LC. 
BETWEEN THE EXPERIMENTAL TREATMENT Medium I.C. 


859 
624 


56X 
41% 


.83 
.50 


1.89 
1.45 



AND TK£ DEPENDENT MEASURES. 
♦High internal consistency produces 
higher Mgg. 



N = number of effect size scores, 
figg = mean effect size score. 

SDpo = standard deviation of effect size scores. 
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As we see in Table 2, the degree of internal consistency between 
experimental treatments and outcome measures » almost equally divided 
between those coded in the high and moderate internal consistency 
categories. An example of high internal consistency would be a treatment 
which teaches vocabulary and then uses a vocabulary test as the dependent 
measure. However, if the investigator had chosen to measure the outcome 
with reading comprehension questions the internal consistency would have 
been coded as moderate. When this variable is examined, high internal 
consistency appears to produce higher average effect sizes (.83) than does a 
more moderate match (.49), This finding is not surprising. Many other 
studies have demonstrated that students are quite attentive to the specific 
demands of classroom instruction, and master the skills needed to complete 
these activities successfully. What seems more important in the realm of 
reading comprehension is whether instruction improves students ability to 
transfer these skills and abilities to new encounters with text. 

Summary profile. These findings concerning dependent measures may 
be summarized by adding some other dimensions to our profile of the average 
reading comprehension study. A study most typical of our data, uses a non- 
standardized test consisting of reading comprehension questions as one of 
several outcome measures. These measures are also likely to contain 
whole texts and to be closely or moderately matched to experimental tasks. 
When the dependent measures are nonstandardized, or highly consistent with 
instruction, or when measures use small units of text such as words, 
average gain effect scores are higher. 

Substantive Findings 

The findings presented thus far have focused on the research designs 
used in reading comprehension studies. I have already presented 
considerable data to support the assertion that design features can 
differentially effect the size of gains made by students participating in 
experimental treatments. Meta-analysis seems particularly good in helping 
to make this type of generalization. But because the studies coded into each 
substantive category of our taxonomy are methodolically diverse, our team 
has approached the task of making instructional recommendations from this 
data with the greatest caution. As we have continued to read, reread, code, 
and synthesize studies using qualitative meta analysis techniques, we have 
become increasingly suspicious of the notion that a single descriptive 
statistic (the average effect size) can describe any category of reading 
comprehension research effectively enough to allow us to make instructional 
decisions. Yet, this is just what the strongest proponents of meta-analysis 
would suggest. For example. Glass (1977) provides the hypothetical 
example of a senator conducting NIMH hearings on psychotherapy who uses 
meta-analysis findings to make funding decisions. We do not believe that the 
simplest answers are always the soundest guides for educational practice. 
For this reason 1 present these substantive findings with cautions against 
overinterpretation of their significance. Only through careful examination of 
the studies in each category can the importance of the average effect sizes be 
interpreted. 
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The findings which are presented below address issues related directly 
to the purpose of this research project, that is, to make recommendations 
for improving the reading comprehension skills of handicapped students. The 
first group of substantive variables Includes subject characteristics such as 
reading achievement level, grade level, handicapping condition, class 
placement, sex, race, and income. Like the methodological variables, these 
subject variables summarize across all types of experimental treatments 
providing us with general information about the responses of different groups 
of students. A second group of variables deals with specific characteristics 
of experimental treatments . Here average effect sizes reflect the variation 
between the different types of subjects, the different methodologies 
employed, as well as the differing purposes and procedures of experimental 
treatments coded in a particular category. I will first discuss subject 
variables and then treatment variables. 



Subject Characteristics 



Because this research project was funded to make recommendations 
for Improving Instruction with a particular populatlon--'handlcapped 
students'—subject variables take on special importance. One of the most 
striking findings of our study is the extremely small number of studies 
(n-37) m this data base which study the effect of reading comprehension 
instruction on special education students. Only 1 13 (7.4%) of the effect size 
scores came from studies with 'special' students, and this number includes 
students described as mentally retarded, learning disabled, emotionally 
disturbed, and hearing impaired. See Table 3 for this data. When an average 
effect size Is computed across all these handicapped categories the mean 
effect size is 1 .20. This is considerably higher than that of the non-labeled 
students (Mes= .65). While reliable interpretation of this effect size is 
difficult given the small number of studies and the great variety of students 
and types of treatments from which it is derived, it does at least indicate that 
experimental interventions can have quite positive effects on the reading 
comprehension of handicapped students. However, the strongest implication 
of these data is a practical one. At present, any recommendations 
concerning comprehension instruction for special students must be based on 
:esearch with non-labeled populations. Because of the small number of 
effect size scores in each category, it is also impossible to make any 
statements concerning the differences between placement of special students 
in self-contained or mainstreamed classrooms. 



Other findings indicate that, overall, about 50% of effect sizes came 
from subjects classified as good readers. The data for this finding is shown in 
Table 3. It Is Interesting that the average effect size computed from the 288 
scores produced by studies with poor readers (Mes- .80) is slightly higher 
than that of the good readers (Mes= .74). Once again this is a tentative 
indication that researchers are using instructional treatments which are 
effective in improving the comprehension of less able students. However, 
more specific conclusions require careful examination of the characteristics 
of these treatments. It is possible that methodological factors such as high 
internal consistency and choice of structured outcome measures may be 
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Tsble 3 

Substantive Findings: 
Subject Characteristics 



The average reading comprehension study Variable N' % H^g ^es 
In our data base: 



Chardcteristics of Subjects: 

1- STUDIES NON-HAKOICAPPED STUDENTS Non-Hand. H24 93% -65 

All Hand, 113 7% K20 

♦Handicapped students benefit 
more than non-handicapped students. 



2. STUDIES GOOD READERS Good Readers 755 49% -74 1.30 

Poor Readers 288 19% .80 2.83 
Mixed Groups 482 31 % -58 1.46 

*Good and poor readers maice 
similar gains. 



3. STUDIESSTU0ENTSm6RADES4-6 



* Intermediate grade students have 
the highest M^g 



Grades 1-3 179 12% .58 1.07 

Grades 4-6 775 50% .85 2.17 

Grades 7-9 103 7% .53 .68 

Grades 10-12 142 9% .62 1-45 

Grade 13+ 228 15% .56 -55 



N number of effect size scores, 
= mean effect size score, 

SDes= standard deviation of effect size scores. 
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influencing both this result and that for the special education students 
reported above. 

A final subject variable to be discussed here is grade level. As shown 
in Table 3, our meta-analysis data indicate that 50% of the effect sue scores 
Involved students in grades four through six, with another 12% from studies 
of primary students (grades one through three). A total of 15.9% of the 
scores came from junior high and high school students, and a slightly 
smaller number ( 14.8X) came from college students. Inspection of the 
average effect sizes in these categories shows the largest gain m grades four 
through six. 

There are several variables about which we cannot make any 
statements. Two examples are the sex and race variables. Most studies 
used samples of mixed sex and racial composition or else reported no 
information on these variables. Similarly, few studies provided information 
on the Income level of students and thus no generalizations can be made. 

Summary profile. Once again It Is possible to summarize these 
findings by enlarging the profile of subjects in the average comprehension 
study. Our data indicate that typical studies draw their samples from the 
population of non-labeled, intermediate grade students who are good 
readers. There is also some evidence that studies focusing on intermediate 
students or special education students have higher effect sizes than other 
studies. 

Treatment Characteristics 

The taxonomy we developed allowed us to code each experimental and 
control treatment simultaneously on seven variables. Two of these variables 
involve the types of materials used in the treatment, and lOur others reflect 
the researchers* attempts to experimentally manipulate reader, text, task, 
and processing strategy characteristics. The last variable, dominant focus 
of the treatment, was selected from among the reader, text, task, and 
processing strategy codes already assigned. 

Our findings indicate that overall, researchers tended to use materials 
that they had designed or specially altered for the purposes of the study 
(67X). Data presented In Table 4 also Indicate that the second most 
frequently used materials were selections from commercially published 
reading series (31X), with only a small fraction (3Z) of the studies making 
use of trade books, newspapers, or other texts not designed specifically for 
instruction. Examination of the differences in mean effects sizes for 
researcher-made (Mes=,80) and commericially published (Mes=.49) 
materials indicates that researchers may have made some positive changes 
in instructional texts, or alternately that these texts were more tailored to 
the Instructional tasks than were the commercially available materials. 

While these results provide an overall picture of the materials used, 
examination of the interaction of this variable with the type of study ( 'basic 
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Substantive Findings 
Treatment Characteristics: Materials 



The averaqe^ reading comprehension 
study in our data base: 



Variable 



I . USES RESEARCHER-DESIGNED MATERIALS 



♦Materials designed specifically for use 
in a particular treatment produce 
higher Mes. 

* In basic processes studies 89% of the 

materials were researcher-designed. 
» In instructional studies 40Z of the 
materials were researcher-designed 
and 60% were published. 



N 



Res. -made 

Published 

Trade 



1027 
468 
42 



67% 
31% 
3% 



.80 1.95 
.49 1.17 
.62 .69 



2. USES WHOLE TEXTS IN THE EXPERIMENTAL Sentences 83 5% 1.93 4.98 

TREATMENTS Paragraphs 186 12% .99 2.02 

Multiple qs 493 32% .54 1.04 

Texts 714 47% .63 

-Treatments focusing on smaller 
linguistic units produces larger Mgg. 



N= number of effect size scores. 
Mgg = mean effect size score. 

SDpo = standard deviation of effect size scores. 
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process' or 'instructionaD provides an interesting pattern of results. We 
found that in basic process studies 89X of the materials used were 
researcher designed, but in instructional studies only 40r fell into this 
category. For the latter group 60X of the materials were drawn from 
commercially published reading Instruction series. This seems to indicate 
that researchers interested in making statements about instructional 
interventions are concerned with the ecological validity of the materials they 
incorporate fn their studies. They use the materials that are most frequently 
found In American classrooms—basal reading series. On the other hand^ 
researchers interested in the basic processes of reading overwhelmingly 
tend to create their own materials-^usually to highlight some aspect of 
processing. 

The second treatment variable related to experimental materials 
involves the size of the linguistic unit, such as sentences, paragraphs, or 
wjiole texts. As Table 4 shows, the pattern for treatment materials is 
similar to that seen In dependent measures. Studies using whole texts 
generated 47% of the effect size scores, and were followed by studies using 
shorter selections of several paragraphs (32%), several unrelated 
paragraphs ( 12%) and unrelated sentences (5%). As with the dependent 
measures, when sentences were the linguistic unit the mean effect size 
(ries=l .93) was substantially hlgner than any of the other categories. I . our 
study, treatments which focused on smaller linguistic units produced larger 
mean effect size scores. Once again, this finding may be the result of higher 
internal consistency between treatments and measures. It may also be that 
the 'sentence' category is more easily influenced by a few extreme scores 
because of the smaller number of effect size scores coded in the category. 

As I have stressed above, the interpretation of the meta-analysis 
results In relation to specific characteristics of Instructional treatments Is 
extremely pr^oblematic. Though meta-analysis can generate a mean effect 
size score of each of the text, reader, task, and processing strategy 
subcategories, with such a diverse array of treatments in each category it is 
difficult to understand what if any instructional implications are justified 
from these statistics. For example, we have been unwilling to conclude that 
instruction in inferencing is more beneficial than instruction in using macro- 
operators simply because the mean effect size score for inferencing is 
higher. There simply are too many other variables Influencing these 
summary statistics. It is entirely possible that a single category could 
contain some studies yielding very high gains along with some yielding very 
low gains, only to produce a mean effect size which is very similar to the 
grand mean for all of the studies. For us a single mean is not sufficient 
evidence for making important instructional decisions. It does not do justice 
to the care with which researchers and teachers have designed and 
implemented reading comprehension instruction for very specific goals. 

For these reasons, I have chosen not to repoi . the mean effect size 
scores for each treatment subcategory. After reading the studies in each 
category, we feel little sense of the 'fit' between the mean effect size scores 
produced and our own sense the overall conclusions which would otherwise be 
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drawn for each category. Quantitative meta-analysis, as we have 
operationalized it, has not been particularly helpful in answering specific 
questions about reading comprehension instructional treatments. 

With our position on this matter stated explicitly, I will present some 
of the general findings from the text, reader, task, and processing strategy 
categories. Since an average of 11 .2 effect size scores was produced by 
each study, we first set a criterion level of 100 effect sizes for examination 
of a category. Our rationale was that, on the average, these categories 
should contain data from about 10 different studies, and should be large 
enough to be fairly resistant to the influence of outliers. Table 5 shows that 
we identified five categories with 100 or more effect size scores. When we 
examined the studies included in three of these categories, (illustraticns, 
inferencing, and macro-operators) we concluded that they had been 
consistently and clearly defined. However, examination of the other two, 
schema availability and situational context, revealed that these categories 
had been defined too broadly and thus, we had used these categories as a kind 
of 'dumping ground" for studies which didn't fit elsewhere. When we began 
the qualitative meta-analysis, we made final revisions to the taxonomy (see 
Chapter 2). Studies coded as focusing on "schema availability" were 
dispersed among five other codes, and situational context studies were 
distributed among three subcategories. Though most of the categories used 
during the quantitative meta-analysis were well-defined, the ambiguity in 
these two instances seriously limits our conclusions. 

Because so few categories had 100 or more effect size scores, we 
chose 40 as an alternate cut-off point. Table 5 shows that thts decision 
allowed us to add to our list of the most frequently researched hypotheses, 
three text categories (repetition of concepts, explicitness, and cohesion) 
and 2 processing strategy categories ( schema construction, and 
transmediation) . Overall, this list provides a good indication of the strands 
of research which received the most attention in our sample of 137 studies. 

Within the text category, there was considerable attention to the effect 
of presentation versus non-presentation of illustrations, and to the effects of 
different types of ilustrations. Several studies also investigated the effect of 
the relationship between the content of the text and illustrations. Studies 
investigating different types of advance organizers, adjunct questions, and 
titles were coded in the repetition of concepts category and were heavily 
researched. Textual explicitness and cohesion were the other text features 
receiving major attention. 

As for reader characteristics, the schema availability category 
contained a combination of studies focusing on the effect of readers' existing 
background knowledge and on the effect of their ability to access and use 
particular reading strategies. In the processing strategy category, the most 
widely researched topics involved use of inferential reasoning, use of 
macro-operator rJles for summarizing and chunking texts, use of 
melacognitive strategies, and use of mental imagery and art to express 
meanings gained through reading. Many fewer studies had task features as 
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dominant focus, and when the situational context subcategory was examined it 
did not seem to represent ony one Kind of treatment monipulotton. Thus, wc 
are not able to single out one type of task manipulation as especially 
important. 

A final set of results related to treatment characteristics involves the 
Overall mean effect sizes for the text, reader, task, and processing strategy 
variables shown in Table 5. As you can see, studies with dominant focus on 
processing strategies produced a somewhat higher mean effect size 
(Mes=1.04) than did the text (Mes=.77)„ reader (Mes=.60), and task 
CMes=.69) categories. Howevert each of these last three categories did 
produce substantial gains when compared to the nontreated controls, and 
each is quite close to the grand mean of the effect sizqs (Grand Mes=.70). 
Thus, as a general rule, studies in our sample which focused on facilitating 
readers' use of particular processing strategies produced the highest gains, 
but studies focusing on text, resder, and task features were also beneficial 
in improving students' performance relative to the controls. 

Summarv profile . In summary, we found that quantitative meta- 
analysis was not particularly helpful in answering questions about the 
effectiveness of specific types of comprehension instruction. However, it did 
allow us to build a profile of the materials and dominant focus of the typical 
comprehension study in our data base. First, most basic processes studies 
used researcher^designed materials, while instructional studies usually 
used commercially published reading materials ^n the treatments. Second, 
researchers were most likely to use. whole texts in their interventions, 
although choice of an excerpt of related paragraphs was also frequent, 
treatments using materials with smaller chunks of text (such as sentences) 
prouuced higher gains in effect size scores. A third finding indicated that the 
typical study in our data base focused its experimental treatment on 
investigating the effect of: illustrations, adjunct aids, textual cohesion, 
textual explicitness, background knowledge, and availability of reading 
strategies, or on the use of inferential reasoning, macro-operator rules, 
metacognitive strategies, or alternate communication systems. 



CONCLUSION 

Implications for Researchers 

From my perspective, the process of meta-anlysis has been tremendously 
valuable in helping us to approach the enormous task of synthesizing reading 
comprehension research for the past 10 years. If for no other reason, it has 
spurred us to develop a taxonomy which provides a consistent and organized 
means for evaluating reading comprehension research whether or not il is 
submitted to quantitative meta-analysis. We have found this way of thinking 
about research to be a powerful framework, both because it has provided us 
with the common vocabulary for discussing research, and because it has 
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forced us to systematically and thoroughly attempt to understand the studies 
we have read. 

The results which } have presented above represent only one slice of 
our data. However, they do provide some general descriptive information 
both about the methodological and substantive characteristics of reading 
comprehension research produced during the last decade. One clear finding 
related to the overall purposes of this study is that very little attention has 
been focused on comprehension Instruction for special education students. 
Quantitative meta--analysis seemo especially strong in producing the 
bystematic demographic information about research methodology and 
hypotheses which allows us to make such statements. This has been 
tremendously important in helping us sketch the big picture of this field. 

However, from our experience, what meta--analysis does not do well is 
to answer questions about the relative effectiveness of instructional 
treatments--and this is exactly the situation for which Glass has tauted it as 
most useful. Perhaps the most important reason for this is the complex 
nature of the hypotheses currently being tested In reading research. Studies 
making simple comparisons between control and experimental instructional 
treatments are rare. Instead, researchers simultaneously investigate the 
effects and Interactions of a complex of factors which serve to situate the 
instruction in a particular context of situation with particular types of 
learners. As we have attempted to simultaneously code all of the hypotheses 
being tested in each study, we have constructed a picture of reading 
comprehenson which is rich in inter-relationships between text, task, 
reader, and processing strategy factors, and a picture of reading 
comprehension research which is equally rich in the multidirectional 
influences of methodological features. 

To use Spiro & Myers* ( 1984) metaphor, we now see reading 
comprehension end reading comprehension research as an 'entangled domain* 
where *there is at best a partial and irregular overlap of thematic features . 
. - and of the ways relevant features relate to each other on each occaision* 
(p. 493). The activity of attempting to categorjze studies with a neatly 
organized taxonomy has forced us to recognize the tangle of relationships 
which were difficult to capture in its use. Thus ironically, the activity of 
conducting a quantitative meta-analysis has been tremendously valuable tn 
helping us to understand the field. But we are dissapointed in the product 
which has resulted—a set of mean effect size scores. 

Now more than ever, we are unwilling to use single mean effect size 
scores to judge the relative effectiveness of one type of instruction as 
opposed to another. Moreover, we have come to understand that research m 
our field has moved past these univariate questions. Reading, and learning in 
general, is much too complex to be described in simple absolutes. The orily 
answers which researchers can honestly give to such questions are 
necessarily qualified with caveats concerning effects of text, task, reader, 
and processing strategy variables. 
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Our dilemma m conducting a quantitative meta-analysis is analogous to 
the selection of ^0 or 50 individual dots from a photograph for the purpose of 
making judgments about its content. Lven when the data points are chosen m 
such a way as to represent an entire area of the photo, It Is clear that much 
has been lost. When a single point is examined, the inter-relationships, the 
variation, the gestalt of the photograph are gone. To begin to understand the 
photo it is necessary to see where and how the points are distributed, and to 
infer what underlying forms may be represented by their relative positions on 
the paper. Chapters 2 and 12 describe how the use of the taxonomy has 
helped us to see the major types of hypotheses being tested, and their inter- 
relationships in relation to researchers' underlying theories of reading. To 
attempt, then, to interpret the mean effect size score of a category apart 
from this web of relationships is to take an unrealistically simple view of the 
nature of the studies included and of the types of hypotheses researchers 
have tested. It would also require us to ignore the statistical impact of the 
methodolgical diversity of studies coded in each category . 

But I am not arguing that reduction is always impossible or 
undesireable, just that our experience suggests that quantitative meta- 
analysis should be reserved for domains that are narrower, and perceived as 
better structured. Perhaps with careful selection of studies that have 
similar control groups and closely allied instructional goals, quantitative 
meta-analysis could be helpful in determining their relative effectiveness. 
Though this is not in the *Glassian" tradition, it may prove a more reasonable 
use of the technique. It has simply not been our experience that throwing 
everything into the same pot aids detection of differences. 

But how, then, can we begin to answer substantive questions such as, 
*What types of instruction are the most effective in improving reading 
comprehenison*^' 1 suggest that more complex answers must come from 
narrative reviews which consider carefully the specifics of experimental 
interventions. In order to produce a picture of reading comprehension which 
gives the fine grained details we desire, I believe it is necessary to view the 
findings of this meta-analysis from the broader perspective of the entire data 
base, and then to combine the general Images produced by quantitative meta^ 
analysis with the detailed information about instruction which a qualitative 
meta-analysis provides. Chapters 4 through 12 represent the attempts of 
our research team to achieve this Integration, and to address specific 
questions about instruction. 
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A GUIDED TOUR OF THE LANDSCAPES: 
RESEARCH ON READING 
COMPREHENSION INSTRUCTION 

Deborah Wells Rowe 
Indiana University 

INTRODUCTION 



The reading ability of American students is a topic which has come 
increasingly to the forefront of public attention with the release of a number 
of reports on our nation's schools. (See for example, A Nation at Risk , and 
Action for Excellence . ) for educators this is not a new concern. Teachers 
at every grade level and in every content area are daily impressed with the 
importance of reading in the learning process. As concerned teac*iers we 
frequently find ourselves searching for ways to improve reading Instruction 
in an effort to help students increase their comprehension of the texts they 
read in and out of school. We also find ourselves asking, *Where can we look 
for information which will help us improve the reading experiences which take 
place in our classrooms?' This chapter is written primarily to help teachers 
become aware of the resources available to them m their search for better 
methods of reading comprehension instruction, although researchers may 
also be interested in it as a means for reviewing the most frequently 
researched hypotheses in the area of reading comprehension instruction. 

Traditionally, teachers have looked to a variety of sources when they need 
help with instruction^^among them, published reading programs, colleagues, 
university personnel, reading methods textbooks, and professional journals. It 
is this last source, professional journals, which contains reports of current 
research on the effects of instructional techniques. While it is true that 
research journals report some of the most exciting and innovative instructional 
techniques, they are also perhaps the most difficult resource for classroom 
teachers to use. 

One reason for this situation is the grtzi number of such publications. A 
second factor is the difficulty of locating ai licles which relate specifically to 
comprehension instruction, and a third is the difficulty o/ gaining an overview of 
current comprehension research which would enable teachers to choose articles 
which speak mo^t clearly to the problems they face in their own classrooms. 
However, teacher s are not the only ones who have difficulty m gaining this broad 
perspective on the field. 

Over the course of this research project, each member of our research 
team has read literally hundreds of comprehension studies, in order to code the 
characteristics of each study, we have meticulously identified the 
methodological and substantive characteristics and then recor .ed them on the 
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coding sheet seen in AppendU A. One morning at our regular staff meeting about 
oix monlho into the project, I pointed to tho big groy file cobmot filled with 
copies of the 573 studies in our data base and asked, "Do we really know what's in 
those drawers'^* This may have seemed like an odd question, since each of us 
could talk about a great many individual studies, but m asking it, I found that I 
expressed a feeling that had been growing among the research team. Without a 
consistently constructed overview of the data base, none of us were certain 
whether the particular group of studies we had read represented the field as a 
whole, or only some small corner of it. While we were becoming familiar with 
some of the instructional techniques investigated by researchers for improving 
reading comprehension, each of us wondered what we had not yet encountered. 
From this conversation grew the decision that I should consolidate the summary 
data we had available and construct the overview which is presented in this 
chapter. 

Teachers also find themselves in need of this same information. As they 
look for new suggestions to improve reading comprehension instruction, they 
begin to wonder what techniques have already been investigated and with what 
results. Because we have found it so helpful to approach the field of reading 
comprehension research with an overall notion of its contours, this chapter is 
designed to take readers along on a guided tour of its most important landmarks 
as we have come to know them. By building a cognitive map of comprehension 
research produced in the last ten years teachers and researchers should be able 
to choose more productive paths and to avoid dead ends in their search for ways 
to improve reading comprehension. This chapter should be helpful for readers 
who wish to keep abreast of current trends in reading research, as well as for 
those who look to this research for practical suggestions for instruction. 

In the next section, l will focus my discussion on three major trends which 
have emerged from a group of approximately HO studies of reading 
comprehension instruction. These studies are a subset of our larger data base 
containing 573 reading comprehension studies published or prepared between 
1974 and 1984. The remainder of the chapter will be devoted to an overview of 
the types of instructional strategies wh^ch have received the most study in the 
last 10 years. Hopefully, an understanding of the issues frequently addressed 
by researchers will help teachers to identify areas they may wK^h to pursue 
further as they seek to improve their classroom comprehension instruction, i 
will also provide suggestions of how they might use this volume to locate the 
information they need to inform their curricular decisions. 

GENERAL TRENDS IN COMPREHENSION INSTRUCTION 

First, djnng the past decade most comprehension research has come to rest 
on a theory of reading which acknowledges the active role of the reader. 

This IS a trend which has recently been noted by other reviewers of research 
as well (Kamil, 1984). CeneraPy speaking, researchers assume that 
'comprehension is a constructive process in which meaning is derived from 
the text and from inter eclions between the text and the background knowledge 
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Of the reader' (Car r, Dewilz, iPatberg, 1983, p.l). This is in contrast to 
earlier theories which suggested that the act of reading involved a transfer of 
the meaning residing in the text to the reader, and assigned to readers the 
passive role of Information receivers. 

Schema theory (Anderson & Pearson, 1984), which acknowledges the 
active role of the reader, is one widely accepted description of the cognitive 
processes involved in reading. It is currently reflected in both the focus and 
Iheorellcal underpinnings of much inslrucllonal research* Briefly, Pearson & 
Spiro (1982) suggest that people have concepts (or schemata) for objects such 
as chairs and trees, as well as for feelings like love, or actions like running or 
eating at a restaurant. Each of these schemata include a broad range of 
associations derived from personal experience. For example, a reader's 
schema for party may include particular types of food, activities, dress, 
people, or any other feature which has been related to parties in his or her 
experience. When the reader encounters the word 'party* in a text, it is on the 
basis of this complex of past experiences that he or she will interpret the text 
and make predictions about upcoming segments of text. Therefore, a student 
reading with a party schema in mind is likely to interpret the sentence, A bov 
came to the door. ^ as the arrival of a guest rather than the paperboy. 

This theoretical orientation is currently reflected In the large amount of 
instructional research which focuses on factors internal to the reader. When 
readers are seen as active, it no longer enough to simply describe their overt 
reactions to texts and tasks; instead it is important to identify the types of 
cognitive processes involved in these responses. When researchers and 
teachers accept this active, constructive role for readers, it is natural that 
they should begin to focus efforts on designing instruction which helps readers 
make use of their existing background knowledge or helps them to build the 
background necessary for upcoming reading experiences. 

Second, there is a trend toward comprehension instruction whic h focuses on 
higher levels of coonitive processing. 

This IS related to the already mentioned move away from information 
transfer theories of reading, and toward theories which suggest that the reader 
engages in a variety of higher-level thinking processes (e.Ot inference, 
prediction) during comprehension. Figure 1 illustrates the trend toward 
instructional research focusing on higher levels of processing. Throughout this 
10 year period more studies have investigated Interactive and transactive 
comprehension processes than information transfer, and the gap has widened in 
the early 1980 s. The percentage of instructional studies in which the doriiinant 
focus was information transfer (word meanings, identifying text structure, 
etc.) dropped from 39% in the 1975- 1979 period to 302: in period from 1980- 
1984. An opposite trend is seen in the percentage of instructional studies with a 
dominant focus on interactive or transactive cognitive processes (inferencing, 
summarizing, etc. ). The proportion of studies falling in this latter group rose 
from 51% to 702 m the same lime period. This trend suggests thai il is imporlad 
for teachers to plan reading experiences which encourage students to use higher 
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levels of processing* Specific instructional techniques designed for this purpose 
ore discussed below in the section on Processing Strategies, 

Third, there is a trend toward instruction which enrouraqes readers to 
develop and become aware of strategies which they can apply m other reading 
situations. 

Once again, when readers are conceptualized as interacting rather than 
simply reacting to the environment, it is theoretically consistent to devise 
instructional interventions which help them develop and make use of efficient 
strategies for dealing with print. Currently, there seems to be an Increase in 
studies investigating the effectiveness of lessons which teach students to 
consciously select and use strategies for dealing with certain types of texts. 
This is in contrast to earlier studies which focused mainly on discovering what 
types of instruction would elicit the desired comprehension behaviors. This 
newer trend assumes that students, rather than teachers, must be m control of 
the strategies used. 

Pearson and Gallagher (1983) suggest that comprehension Instruction should 
provide for a "gradual release of responsibility from teacher to student' through 
the use of "guided practice' (p. 22). A recent example is an instructional study 
by Bean, Singer, Sorter, and Frazee (1983) in which the teacher first 
demonstrated a three step strategy for the construction of a graphic organizer 
to be used with the students' world history text. Over the next several months 
students engaged in guided practice of the strategy in groups and then 
individually. This allowed them to receive feedback and support as they used the 
strategy, and to gradually come to use It Independently. Instruction which 
encourages students to monitor their own comprehension has become 
increasingly more frequent across the 1974*1984 period, and seems to have 
much to offer in improving comprehension instruction. These strategies are 
more fully described in the section on Reader Characteristcs below. 

These major trends are also reflected in the instructional issues which 
reading researchers have investigated with the most frequency m the last 10 
years. The next section of this chapter will describe the areas of reading 
comprehension instruction which have received the most research attention and 
will present examples of the Instructional techniques which have been studied. 



SPECIFIC TRENDS IN COMPREHENSION INSTRUCTION 

Since the remainder of this paper will discuss trends in instructional 
research in relation to four major categories, a brief explanation of each one 
is in order. Figure 2 provides an overview of the categories and 
subcategories which will be discussed. First, the Reader Characteristics 
category reflects Instances where instruction Is designed to affect internal 
characteristics of readers such as background knowledge, learning style, 
risk taking, or metacognition (awareness of one's own processing 
strategies). Conceptually, this category represents charvcteristics which 
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the reader brings to the reading situation. The second category. Processing 
Strategies ^ reflects the level of cognitive activity which is the focus of 
instruction. Examples are lower level strategies such as identification of 
word meanings and factual recall, and higher level strategies such as 
drawing inferences and summarizing information. Logically, the Processing 
Strategies and Reader Characteristics categories both reflect internal 
characteristics of the reader. While this distinction is somewhat artificial it 
does allow us to describe instructional interventions designed to affect what 
readers bring to the reading situation as well as the processes they use 
during reading. 

The third and fourth categories, Task Characteristics and Text 
Characteristics , represent two dimensions of the instructional environment; that 
Is, they reflect elements external to the reader. Specifically, studies 
discussed in the Task Characteristics category have investigated the effect of 
instructional directions and procedures. Research related to Text 
Characteristics focuses on the effect of the print used In instruction. 

As seen In Figure 2, these four categories can be divided Into a number of 
subcategories reflecting specific research questions addressed in the last 10 
years. The sections which follow will provide a brief introduction to research In 
each of these categories and subcategories beginning with Reader Characteristics 
and Processing Strategies, and ending with Task Characteristics and Text 
Characteristics. 



Research Focusing on Internal Characleristics of the Reader 

Reader Characteristics 

Background knowledge. One reader characteristic that has received 
considerable attention during the 10 year period covered by this review is the 
background knowledge possessed by readers* Basic research in this area has 
shown that the amount of background information possessed by a reader affects 
comprehension (Pearson, Hansen, & Gordon, 1979; Reynolds, Schallert, & 
Goetz, 1977) and also that it is necessary for this knowledge to be activated by 
the reader for it to be helpful (Bransford &. Johnson, 1972). Accordingly, 
researchers have investigated instructional techniques which help readers Dulld 
necessary background knowledge. One interesting study in this area (Stevens, 
1982) used a prereadmg lecture on the Texan War to provide tenth-graders with 
background information related to an upcoming passage, Stevens found that this 
improved subsequent comprehension, Crafton (1983) also obtained positive 
gams in comprehension by encouraging students to generate their own 
background information through reading several passages on the same topic, 

A number of researchers have also suggested techniques which help 
students activate the knowledge they already possess, Langer's ( 1981 ) Pre- 
Reading Plan (PReP) is one such activity. She suggests that teachers present 
a key word, phrase, or picture related to the upcoming reaoing selection and 
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ask students to say anything which comes to mind. In the class discussion 
which follows students ore encouraged to extend and refine these initial 
associations. 

Metacoonition. While the preceding examples deal with the content of 
the readers* world knowledge, researchers have also become increasingly 
concerned with students* metacognition or awareness of their own reading 
strategies. As basic research has shown that good readers monitor their 
comprehension (Brown, 1980), there has been an increase in attempts to 
help children become consciously aware of their own processing strategies* 
Recent examples of such instruction include Cohen*s (1983) attempt to teach 
third-graders to use self-generated questions in order to increase literal 
recall for short stories, and Winograd, Hare, Garner, Alexander, and 
Haynes' ( 1984) use of Instruction to train middle and high school students 
why, when, and where to use the strategy of "looking back" in the text as they 
read. These are just a few examples of the many studies in our data base 
which present instruction aimed at making readers consciously aware of 
effective processing strategies and how to use them. 

Processing Strategies 

A second category of reading comprehension studies focuses on 
Processing Strategies. Like instruction aimed at altering background knowledge 
or encouraging metacognition, studies aimed at affecting students' processing 
during reading primarily focus on internal characteristics of the reader. It 
should be noted, however, that it is often the task and text factors which are 
manipulated to bring about the desired type of cognitve processing. As seen in 
Figure 2, six processing strategies have received most of the instructional 
research attention between 1974 and 1984. These strategies will be briefly 
described and illustrated below. 

Identifying word meanings . The first two Processing Strategy 
subcategories, identifying word meanings and identifying text structure, are 
lower level strategies which mainly require readers to identify elements 
explicitly stated in the text. Studies coded as focusing on word meanings include 
both vocabulary and word identification instruction which has as its goal 
Improving comprehension. Examples of work In this area Include a series of 
studies by Pony and her associates (Pony & Jenkins, 1978; Pony, Jenkins, & 
Schreck, 1982) in which three methods of vocabulary instruction were 
investigated: learning meanings from context during reading, provision of 
meanings by the teacher during reading, and practicing meanings through 
flashcard drills. Examples of other types of vocabulary instruction which have 
been investigated are an experience based discussion approach (Vaughan, 
Castle, Gilbert, L Love, 1982) in which students discussed relations between 
unknown words and their past experience, arid a categorizing method In which 
students placed an unknown word in a category with familiar words (Gipe, 1978- 
79). 

Identifying text structure. Studies which have taught children to identify 
text structure are somewhat, v^arled, as they have focused on a number of 
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different levels of text structure. For example* some researchers (Sampson, 
Valmont, & Van Allen, 1982) focus on syntactic structure through the use of 
instructional cloze materials in which words are selectively deleted to highlight 
particular syntactic elements such as adjectives or verbs. Other researchers 
focus instruction at the level of story structure. Examples are studies which 
teach students to identify story elements such as setting, theme, plot, and 
resolution (Gordon & Braun, 1982) or main events, sequence, and cause^effect 
(Sebasta, Calder, & Cleland, 1982) in attempts to improve story 
comprehension. 

As mentioned earlier, there has been a general trend across the last 10 
years to concentrate instructional research at higher levels of cognitive 
processing. While researchers are still investigating ways to improve literal 
level comprehension sKills, they have become increasingly aware that readers 
must be able to draw inferences, summarize and identify major themes, make 
use of other communication systems (e.g. , illustrations, mental imagery), and 
comprehend metaphors and analogies. Without these processing skills, readers 
truly are little more than functionally literate. Certainly they would be, unable 
to use reading to stimulate learning and thinking in the manner demanded by a 
highly technological society. It is therefore not surprising that attention should 
turn to developing instructional methods which foster the processing strategies 
readers use to go beyond the elements explicitly stated in texts. 

Inferencino. In a recent paper describing the process of reading 
comprehension from a schema-fheoretic view, Anderson and Pearson (1984) 
state that inferencing is one of the key elements in this process. They suggest 
that in order to understand all the explicit Information In a text, "Interpretations 
must be made that often go well beyond the text itself" (p, 38). These 
inferences are necessary because authors never make all the relations in the 
text fully explicit. Instead, they assume that readers will fill these gaps with 
their background knowledge. To illustrate, let me return to my earlier example 
in which a student is reading a passage about a party. It is quite likely that the 
author will not mention in the text that the boy whp arrived at the door was 
previously invited by a phone call or a written note. Still readers are expected 
to use their knowledge of parties and the invitation process to understand 
dialogue where the host greets the boy with, "We were expecting you!'. Thus, 
readers are called upon to infer unstated connections and information by linking 
textual cues to their background of experience. 

Congruent with the importance of Inferencing in schema-theoretic views of 
reading comprehension is our observation that slightly more than one-fourth of 
the instructional studies focusing on Processing Strategies had a dominant focus 
on Inference lnstructlon--m6re than any other Processing Strategy subcategory. 
Researchers have explored a wide variety of instructional techniques to promote 
inferencing during reading. One suggestion has been to provide children with 
increased practice in answering inferential as opposed to factual questions 
(Hansen, 1981). Another example of work in this area is the use of cloze 
techniques (Carr, Dewitz, & Patberg, 1963) v/hich requir^i readers to make 
inferences based on the syntactic and semantic cues present in the text and on 
the background knowledge they already possess. While these and other studies 
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have focused on direct teaching of Infer encing, other exciting instructional 
opporochco ore currently being inveotigoted. Greenlow (in progreoo) lo 
currently invei*cigating the use of high fantasy literature coupled with 
creative/critical reading and writing activities in an attempt to encourage 
4 inferencing* 

Summarizing. A fourth Processing Strategy category which is well 
represented in the instructional research of the past decade is that of 
summarizing. (Ke. , determining the gist or theme of a written text). As used 
here, summarizing ^ntails much more than simply identifying the tojyc sentence 
of a text. Readers are required not only to identify important text elements, but 
often to infer major themes and points which are not explicitly stated in the text. 
In order to form a coherent summary, Kintsch and vanDijK (1978) suggest that 
readers niust aprly the strategies of deletion, generalization, and construction 
to the information available in the text. An example of classroom instruction 
using these summarizing strategies is reported by Taylor ( 1982). In her study, 
fifth-graders were taught to prepare and study a hierarchical summary for a 
passage from their health book. These students were first taught to prepare a 
skeleton outline of the segment which closely followed the text s organizational 
structure, and then to generate a summary statement for every paragraph, 
section, and subsection of the text. Bean, Singer, Sorter, and Frazee (1983) 
used a similar strategy with tenth-graders. The major difference being the use 
of a gr .phic Oi ganizer instead of an outline. These and other techniques aimed 
at increasing students" ability to comprehend the theme of a text are currently 
receiving considerable attention. 

Transmediatlon. The final two Processing Strategy subcategories to be 
discussed here are transmediation and metaphor and analogy. Both can be 
considered transactive processes because they require the reader and text to 
come together In such a way that totally nev/ meanings are created and both 
reader and text are changed in the process. Transmediation requires the reader 
to move from one communication system to another; that is, readers first 
express a meaning in written language and then through another sign system 
such as mental imagery, art, music, dance, math, etc. Through 
transmedlat'on, readers re- represent knowledge they have gained through 
reading. Because each communication syste n has its own expressive strengths 
and limitations, the process of transmediation encourages readers to see their 
knowledge In a new light ;.nd to create new understandings as well as connections 
between exiirting and newly formed concepts. The most frequent instructional 
activities requiring transmediation come from studies which ask students to use 
mental imagery or an to represent what they have read. For example, Pressley 
(1976) trained childrer to *make pictures in their heads* about the stories they 
had read, and Lesgold, McCormick, and Gclinkoff ( 1975) asked students to 
illustrate passages with stick figure cartoons. These studies and others, such 
as SiegeTs (1984) introduction of a strategy where students respond to t eoding 
through art, are representative of ins ructional techniques involving 
transmediation. 



Metaohor a. J analogy. Instructiona't strategies using metaphor and 
analogy have also generated considerable interest in the late 1970's and early 
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1980 s, Hayes snd Tierney ( 1982) note that comprehension may be aided by 
the use of analogies because readers can transfer the properties of known 
concepts to unknown ones. In this way, new knowledge categories can be 
created and links between them are formed. Examples of Instructional 
applications of analogy and metaphor are studies by Hayes and Tierney (1982) 
and Linden and Wittrock (1981). In the former study, the researchers 
presented information about the unfamiliar game of cricket m passages which 
also contained analogies to the familiar game of baseball. The attempt in this 
lesson was to help readers link the new information on cricket with their 
existing background knowledge through provision of explicit analogies in the 
text- Linden and Wittrock, on the other hand, asked students to generate 
their own metaphors and analogies in order to relate the text to their 
personal experiences. 

Summary. In summary, the Reader Characteristic subcategories of 
background knowledge, and metacognition ,and the Processing Strategy 
subcategories of word meanings, text structure, Inferencing, summarizing, 
transmediation, and metaphor and analogy are the focus of most of the 
msiructional research dealing with internal characteristics of readers during 
the 10 years under study. The research questions addressed are reflective of 
the three major trends presented earlier m this chapter. Readers are seen as 
actively constructing meaning by using their current knowledge about the world, 
applying a variety of cognitive strategies, and monitoring their own 
comprehension. This view obviously has strong implications for reading 
comprehension instruction. Teachers may want to further Investigate some of 
the areas outlined above, as many interestirig suggestions for improving 
classroom comprehension mstruction are included in these research reports. 

Research Focusing on the Instructional Environment 

While the studies reported thus far have primarily focused on 
interventions designed to affect the internal characteristics of the reader, our 
data base also contains instructional studies in which features of the 
instructional environment are especially highlighted. These studies fall into the 
Task Characterist.es and the Text Characteristics categories. Naturally, any 
task or text manipulation may also be expected to affect the reader's 
processmg. In fact, the studies reported as having a dominant focus on Reader 
Characteristics or Processing Strategies often manipulated the text or task in 
the instruction as welL However, it seems clear that some studies are designed 
explicitly for the purpose of testing the effect of some particular feature of 
instructional tasks or texts. These studies will be discussed under the headings 
of Task Characteristics and Text Characteristics, with the understanding that we 
also recognize that these manipulations affect internal reader characteristics. 

Task Characteristics 

Teacher expectations and behaviors, instructional research on reading 
comprehension during the last 10 years seems to fall largely into three Task 
Characteristics subcategories, as seen in Figure 2. The first subcategory 
contains a group of studies which investigate the impact of teacher expectations 
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and behaviors. For the most part this group of studies involves the effects of 
Icochcr bchOYiora ouch 03 qucdtioning techniques (Goll, Word, Berliner, Cohen, 
Winne, Elashoff, & Stanton, 1978), correction of errors (Kibby, 1979), or 
emphasis on oral reading accuracy (Furniss &t Graves, 1980). These studies are 
especially interestmg because they provide evidence concerning the impact of 
teachers* instructional behaviors. 

Modality. A second task factor which has been the subject of a number of 
investigations is the impact of the modality through which children encounter a 
text. Examples are studies which contrast comprehension under inslructional 
conditions of silent versus oral reading (Wiesendanger 5c Birlem, 1981 ) or of 
listening versus reading (Marlowe, Egner, & Foreman, 1979). Once again these 
studies address a question which if relevant to many instructional decis ons 
made by teachers. 

Lesson frameworks. The third subcategory of Task Characteristics is 
labeled lesson frameworks. This is a term borrowed from a recent review of 
comprehension instruction by Tierney and Cunningham (1984) and generally 
refers to studies which Investigate the effects of comprehension lessons 
containing steps which: (l) establish a purpose for reading, (2) require 
students to read a passage, (3) require students to perform a task which 
reflects the accomplishment of the readinc, purpose, and (4) provide feedback 
concerning comprehension based on task performance. Most of the instructional 
lesson frameworks included in this category contain some or all of these steps 
and can be considered guides for planning comprehension lessons. 

Many of the lesson frameworks which have been investigated In the past 
decade have also been incorporated into published basal reading lessons, or are 
a modification of widely used guided reading lessons. An example is the guided 
reading strategy used by Bean and Pardi (1979) which is a combination of the 
Guided Reading Procedure used by Manzo (1975) and the initial steps of 
Robinsons ( 1970) SQ3R study procedure. Bean and Pardi instructed students to: 
(1) survey a section of the text by reading only the titles, charts, etc.; (2) 
orally retell everything they remembered from the preview, (3) recheck the 
chapter for missing information; (4) organize this information into an outline; 
(5) read the text silently; and (5) complete a true-false quiz on the textual 
material . Another example is a study by Biskin, Hoskisson, and Modlm ( 1976) 
which contrasts Directed Readmg-Thinkmg Activities (DR-TA) in which children 
make predictions about story content with Reflective Reading Thinking Activities 
(RR'TA) in which the emphasis is on evaluation and Interpretation of stories. 
These ore just two examples of the many studies in our data base which 
investigate the effectiveness of particular types of compiehension lessons. 
Since many of these strategies are similar to the guided reading lessons In 
current use, this may be an area where teachers can find suggestions which are 
immediatly applicable to their comprehension instruction. Examination of 
researchers' rationales for making these modifications, should also help 
teachers think about their own instruction in new ways. 
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Text Characteristics 

The fourth major category of instructional studies focuses on Text 
Characteristics; that is, they study the effects of the printed texts used m 
instruction. Overall, only a small percentage of instructional studies have text 
factors as their dominant focus* Instead, most of the studies In our data base 
with a dominant focus on text manipulations are primarily interested in 
investigating students' processing strategies by presentation of altered texts, or 
determining U.e effects of a particular text feature such as the repetition of 
concepts, figurative language, syntactic complexity, or story structure on 
comprehension. V/hile many of these studies do not fit the definition of 
instruction used in this paper (i.e. , an intervention that is designed to be used 
with students in classrooms), they are important in two ways. They provide 
Information wMch is helpful for the authors of instructional materials, and they 
highlight the need for teachers to plan instructional strategies which help 
students deal with particular features of the texts they read. 

Written orereadinQ activities/adiunct questions. Instructional studies 
have been primarily focused on the effects of two types of Text Characteristics: 
written prereading activitics/adjunct questions, and illustrations. In the first of 
these subcategories, written prereading activities/adjunct questions, 
researchers have focused on repeating or highlighting some feature of the text 
by the use of structured overviews, advance organizers, titles, headings, or 
written questions inserted in the text. Many of these instructional techniques 
involve presentation of a written prereadmg activity designed to help students 
link the upcoming text to their background knowledge and to make predictions 
about Its content. Representative of the studies In this area are Bean s (1978) 
use of a structured overview and Royer and Cable's ( 1975) presentation of two 
conceptually related passages. In the former study a structured overview 
consisting of a hierarchically organized overview of the upcoming passage was 
presented as a guide to prereading discussion. In the second study the 
researchers presented a passage which discussed a topic in concrete terms 
before introducing a passage conidimng a more abstract discussion of the same 
topic. 

A second group of instructional studies in this category investigates the 
effects of presenting wr,tten questions before, after, or embedded in a residing 
selection. These techniques are commonly labeled adjunct questions. Two 
examples arc studies using postreading questions of different types with fifth- 
graders (Wlxon, 1984) and with undergraduates and Navy enlisted men (Ellis, 
Konoske, Wulfeck, & Montague, 1982). Since teachers have been observed to 
make considerable use of questioning during reading lessons (Ourkin, 1978-79; 
1984), Information on the effects of Inserting different types of written 
questions at various points in texts may also bo of special interest. 

Illustrations. The last Text Char^icterisics subcategory providing 
information directly relevant to instruction, is research on the effects of 
illustrdlions. An important research question has been whether illustrations 
facilitate or detract ^rom students' learning. An example is a study by Hayes 
and Readence (1982) where the comprehension of eighth-graders is compared 
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when texts are presented v/ith and without illustrations, and also with and 
without instructions to attend to the illustrations. Another interesting study 
(Cohen Si^ Stover, 1981) investigated the effect of accompanying math word 
problems with diagrams. Studies tn this area may be especially interestino for 
teacher o involved in designing their own instructional materials or selecting 
published materials for use in their classrooms. 

Summary. The most heavily researched features of the instructional 
environment have been the Task Chareceristlcs of teacher expectations and 
behaviors, modality, and lesson frameworks and the Text Characteristics of 
written prereading activities/adjunct Q'jeoiions, and illustrations • Like 
research on internal reader characteristics, s*udies of the instructional 
environment have increasingly come to reflect the active role of readers. In the 
past, manipulations of the instructional environment were based on the 
behdviorist notion that task and text features simply elicited responses from 
readers. Much of the newer work in tnis area incorporates the schema- 
theoretic notion that comprehension is a result of an interaction or transaction 
betv/oen readers, >c^ta, and tasks. Investigation in this area offers some 
insight into the iranner in which instructional tasks and texts affect reading 
comprehension. 



CONCLUSION 

In this chapter I have presented an overview of some of the major trends in 
research on reading comprehension instruction during the period from 1974 
to 1984. I have also introduced the areas receiving the most research 
attention and provided a few examples of the instructional tecnniques which 
characteriie work in each area. Like many guided tours, little time has been 
devoted to in-depth investigation of any of these areas. Instead, I have 
chose*^ to provide a glimpse of the most important landmarks, hoping this 
will give readers enough familiarity with the territory to revisit those areas 
which seem most interesting on their own. 

For readers who now wish to seek out detailed descriptions of 
Instructional lessons, there are two ways In which this voiume may be of 
help. First, members of our research team have reviewed and critiqued 
instructional techniques in each of the remaining chapters. Each of these 
authors provides descriptions of some of the instructional interventions 
which researchers have investigated during the past decade. In cases where 
readers feel the need to directly consult the research reports cited In these 
reviews. Appendix C provides full bibliographic information on all 573 
reading compreherision studies In our data base. 

A second approach to this body of research is made possible through 
the information contained in Appendix B. Here readers will find a lis! of 
hypotheses which positively state the major aims of research in each of the 
categories of our taxonomy. In addition, under each hypothesis is 'isled all 
of the studies which have been coded as having a dominant focus in that 
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category. With this information, readers can consult the main bibliography 
m Appendix and find the information necessary to locate the studies. In 
this volume we have attempted not only to present our own conclusions aboot 
research in the area of reading comprehension, but also to make available to 
our readers the data base from which we have worked. Hopefully, with a 
general notion of 'what's out there* and "what has already been tried* readers 
will be able to further explore those techniques which seem best fitted to 
their current instructional needs or research interests. 



Chapter 5 



UNCHARTED LAND: 
READING COMPREHENSION RESEARCH 
WITH THE SPECIAL EDUCATION STUDENT 

Diane Stephens 
Indiana University 

INTRODUCTION 



In October of 1984, several hundred classroom teachers 
and school administrators gathered at Indiana University's 
Memorial Union to attend the annual Fall Language Arts 
Conference. At 9:30 a.m. a subset of this group attended a 
session on reading comprehension research with special education 
students • The presentation began with an invitation for audience 
participation. 

"We've spent the last 12 months reviewing reading comprehension 
research," the panel began, "but rather than present findings 
that you may not consider especially relevant to your particular 
teaching situation, we'd like to turn this session over to you, 
to invite you to raise the kinds of questions that more concern 
you. And we'll do our best to answer them for you." 

One panel member stood at the chalkboard ready to record the 
questions. "How much phonics instruction should special children 
receive?" was the first question raised. 

"I have a question about teaching vocabulary." began a second 
member of the audience. "Should I introduce new words before or 
after I have the kid read the story?" 

A participant standing in the far corner of the room had a 
question about controlled vocabulary. "Is it really best to use 
short sentences with students? I mean, is there any new 
information about controlling vocabulary? Should we be concerned 
about it or not? No one seems to know." 

The "secretary" was barely keeping up with the questions that 
were being generated and more and more hands were going up. 

"What about comprehension? When should it be introduced?"/ a 
local elementary special education teacher asked. 

"And what about reading methods in general?", asked another 
teacher. ,"What really is the most successful method of teaching 
kids who have been labeled as handicapped?" 

(scenario by Jean Anne Clyde, 1985) 
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In October 1983/ which is when our research bo^^n, our intent was 
to provide well documented answers to the these kinds of 
questions. A year and a half later ^ we find that instead of 
having many well supported answers, we have a few tentative 
answers and a gteat many questions. The explanation is simple: 
In our search of the literature, we were able to locate 574 
reading comprehension studies and only 45 of the 574 involved 
special education students* We had not anticipated this 
scarcity. Special education students are students at "high risk" 
- we had hoped for an extensive research base on vhich to ground 
instructional recommendations. V^e found that such a base does 
not exist* 

We were unable to locate any adies with students labeled 
er.iot ionally disturbed and identified only four studies with the 
hearing impaired and four with the mildly mentally handicapped. 
It seerjed impossible to generalize from such a limited research 
base. 

There were 37 studies done with students labeled learning 
disabled - which included one study done with two hyperactive 
learners. Generalization here i^eemed equally impossible as much 
controversy exists as to whether or not the label learning 
disabled identifies a homogeneous population. It has been 
suggested that the criteria for labeling varies from school 
district tc school district (and sometimes from one school to 
ancther within the same district). 

Reading comprehension research with these special education 
students had just begun; most of the studies had taken place 
sin-e 19S0. The landscape was virtually uncharted. 

Although we did not find the answers we expected, we 1) did 
gain an understanding of what research has been done, 2) learned 
enough so that we can talk about what is possibily helpful and 3) 
identified implications for both research and instruction. 

It i£ these topics that will be explored in this paper. The 
first section - a survey of the research - has been subdivided 
into specific handicapping conditions. The second provides a 
brief synthesis across handicapping conditions while the third 
and fourth sections of the paper - i^rplications - focus on the 
questions this review generates for instruction and for 
lesec^icb. 

'^his paper is intended to prompt resoarcheis and 
theoreticians to turn at least 'iome of their attention to reading 
corpiehension with special education students. Our research has 
led us to believe that reading comprehension instruction with 
these student;> it, pioceeding without eithei a research base or an 



LAIJDSCAPES: SPECIAL EDUCATION 



5:3 



ERIC 



explicit theoretical base* This is important because it suggests 
that those students whu appear to need the u^st support roay be 
getting the least, 

A Survey of the Pesearch 

Research with the Mildly Mentally Handicapped (MiMH) 

Descriptive Studies* Bos and Tierney (1984) compared the 
quantity and quality ot inferences generated by retarded and 
non-retarded students reading at the intermediate level and found 
that vvhile both groups generated the same number of inferences, 
the inferences generated from expository material were 
qualitatively different. The mildly retarded students generated 
fewer plausible inferences and more implausible ones. However , 
there was no significant difference between the quality of the 
inferences generated on the narrative material. Bos and Tierney 
suggest that this study "lend(s) support to the notion that 
retarded students are engaging in the cognitive processes 
necessary for generating inferences" (p*80) and conclude that the 
differences between the groups appears to be an artifact of 
instruction in that special education students may not have the 
opportunity to read, and thus develop schema for, expository 
text, 

Healy (1982) focused on describing those students having 
hyperlexia - "a unique disorder in which children notably delayed 
in language and cognitive development begin spontaneously to 
recognize words at a very early age and continue to develop 
surprisingly advanced word recognition skills" (p. 3'19) . The 
twelve i^tudents described by the study were characterized as 
having difficulty with comprehension above a literal level and as 
being "deficient in foimation and organization of schemata for 
incorang experience" (p. 319). 

Instructional Studies. Two of the studies involving students 
.labeled Mildii Mentally Handicapped (MiHH) sought to improve the 
earner's ability to answer literal and inferential questions 
(Peleg and Moore, 1982; Samuels, Dahl, and Archwamety, 1974). 
Peleg and Moore (1982) were interested in understaanding the 
effectiveness of advance organizers. An advance organizer, as 
described by Peleg and Moore, 

is actually an introduction presented to learners 
before the material to be presented^ The introduction 
contains an overview of the structure of the unit of 
instruction and also creates a connection between the 
new material to be learned and information already in 
the learner's cognitive structure. (p*621) 

Peleg and Moore provided 96 students labeled Educably 
Mentally Retarded with an advance organizer introduction, a 
traditional introduction or no introduction and asked the 
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students to either read or listen to a 1000 word passage about 
monkeys. The researchers found that students receiving the 
advance organizer introduction to written text answered more 
literal and inferential questions correct than did the students 
in the other two treatment conditions* 

Samuels et.al, (1974) taught 30 mentally retarded students 
(mean I.Q. 72) a hypothesis-test R^ethod of word recognition. 
Their method was based on Samuels* partial model of word 
recognition . 

According to the partial model of v;ord 
recognition, four stages are involved in 
recognizing a target word* In the first stage the 
words preceding the target wqrd are read for 
meaning. This information is used in the second 
stage to generate one or more hypotheses as to 
the identity of the target word. In the third 
stage, v:sua3 information consisting of one or 
more letteis- is picked up from the target word 
and tested against the predicted word. In the 
final stage, the hypothesis is accepted or 
rejected depending on whether the word fragments 
perceived match the target word. Speed of 
recognition is determined partly by the amount of 
visual infoiruation from the target word necessary 
for verifying a prediction. The less visual 
infornaticn required, the faster is the 
recognition. ( p. 836) 

Students lecelved 4 hours of training per week for 14 v^eeks. 
They were trained op the subskiJls that task analysis had 
determined were involved in each of the four stages. On a 
modified cloze test given to assess comprehension, the students 
in this hypothesis test treatit^ent group did significantly better 
than the students in the control group. These i^tudents were also 
better able to deterrtane word meaning in ambiguous contexts. 
R esearch vith the Hearing Impaired 

Descriptive Studies. Ewoldt (1981) sought to investigate 
the reading strategies of deaf leaders as opposed to hearing 
students. Her study ^.uggectcO llc'l both groups of readers used 
similiar strategies. These strategies include "predictiiig , 
chunking/ using their own dialect, using periphera) field 
information, and developing concepts through reading." (p. 945) 

Instructiona] Studies. ^^aJlcolm, /Mberfcini, Burke, and 
Humphrey (1980) were interested in the teacliing environment; they 
wanted to see if comprehension wa^* facilitated by 
inter-discip] inary teaching. In the treatment group 

the fii^t le^r^on in each sc-t t»f four v/as taught by an 
audiologi^t and included opeech reading practice using 
a special light and switch assembly. Thie allowed the 
audiologisjt to alternatively have a light ^bino on her 
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face or have the printed passage appear on the video 
screen*. .The third lesson in each set of four was 
taught by a speech pathologist. Individual words on 
the glosssynograph were replaced with cards and 
students asked each other prepared questions, (p. 436) 

An English teacher taught the second and fourth lessons for 
tiie treatment group and all the lessons for the control group. 
Studying the results of the fourteen week instructional program, 
the researchers concluded that students receiving 
intet -disciplinary instruction had higher comprehension scores* 

McGill-Franzen and Gormley (1980) and Robbins (1983) were 
interested in the influence i..f context on the comprehension of 
hear ing--impaiied students. Mc0ill-Fran2en and Gormley found that 
students understood passive sent\.nces better when they were 
enbedded in context* Robbins reported that students answered 
more literal and inferential questions correctly when provided 
with a text that contained both sign language pictures and 
Engl ish. 

Researc h with the Learning Disabled 

Before discussing the research in this area, it is critical to 
elaborate on an issue raised in the introduction: the controversy 
what exists concerning the label of learning disabled, Friedrich 
et.al. (1984) suggest the possibility that "learning disability, 
as presently and loosely defined by federal and state criteria, 
does not exist as a unique psychological entity" (p,209) while 
Bognai and Hartj*j (1982) note that the entire process of labeling 
students is without a theoretical base* Other researchers (Berk 
3984, Kiilen & M^klebust 3980) criticize the discrepency method 
of identifying these learners as being neither valid nor 
reliable; that it neither distinguishes students as it claims, 
nor does so consistently. The use of subtest scores on the WISC-R 
(Weschlex Intelligence Scale for Children-Revised) has a3so been 
critiised as having validity for groups, but not for individuals* 
In other words, while "there may be a characteristic WISC-R 
profile for 3earning disabled individuals as a group, few 
individual learning disabled students may actually conform to 
this pattern" (Dudley-Marling, Kaufman, and Tarver, 1981, p. 
33R) * 

It has also been suggested that the population labeled 
Itarninij disabled is not a homogeneous population and that it 
;^hould not be studied as such (HcKinney, 1984; Norman and 
Zigmond, 1980; Pyckraan, 1981)* While some advance the idea that 
subgroups should be identified (McKinnCi , 1984; Ryckman, 1983), 
still others accept the position of Ysseldyke, Thurlow, Graden, 
v;esson, and Deno (1984) who suggest that in studying students 
l3te!€d learning disabled 

researchers have compiled ctn interesting set of 
findings on a group of students who aie experiencing 
academic difficulties, who bother their regular 
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classroon» teacher and who have been cJassified by 
societally sanctioned labeJers in order to remove theirt, 
to the extent possible, from the regular classroom 
mainstream*" (p. 89) 

Given the extent and intensity of the controversy, it seems 
best to consider the research reviewed below as research on 
students who are neither physically nor mentally handicapped, but 
who are not experiencing academic success • 

Thiity-two of the thirty-seven studies have taken place 
bince 1980 and most are instructional studies. For the purposes 
uf this review, the thirty seven have been categorized by their 
primary focus: text, reader, processing strategy or task. 



Research witl the Learning Disabled: Text as dominant focus 

Descriptive Studies. Armstrong (1983) was interested in the 
relationship of material difficulty to reading comprehension 
scores. He provided 5 students with two different levels of 
Barnell Loft and found that students answered fewer questions 
correctly on the more difficult material. 

Instructional Studies. Harber (1983) hypothesized that 
illustrations would interfere with the reading comprehension 
scores of learning disabled students. The Gray Oral Reading test 
with illustrations, without ilJustrations or v;ith partial 
illustrations was given to 76 learning disabJed and normally 
achieving elementary school children. The results suggest that 
the illustrations, both partial and full, had a detrimental 
effect on the scores of the Jearning disabled students in the 
iriddle and hi9h reading groups i 



Research with the Learn ing Disabled: Reader cs dominant focus 

Descriptive Studies. Dowdy, Crump, and Welch (1982) 
established ditterent purposes for reading and found that 
learning disabled students in grades four and seven adjusted 
tbeii rate to the purpose for reading while those in the tenth 
yiadc did not. The flexibility of non-labeled learners remained 
consistent across all three grades. (Dowdy et.al. (1982) also 
repotted on the comprehension scores and reading rates of these 
two gioups; those results are discussed in the next section under 
rate.) 

Griffin, Walton, and Ives (1974) compar^l the eye movenienli> 
of good (non-labeled) readers with poor (learning disabled) 
readers and found that saccadec. (eye movement patterns) could not 
i;c>ed to differentiate the readers. 

Bos and Filip (1984) were interested in comprehension 
, fiicnitoring strategies. Students from both populations, matched on 
grade level, read an expository passage that contained text 
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inconsistencies (contradictory sentences embedded in a 
paragraph) in both a cued and non-cued condition. The students in 
the cued condition were told 



There is something tricky about this essay* There is 
something that does not make sense and confusing, I 
would like you to try and spot the problem with the 
essay and tell me what it was that did not make any 
sense, 231) 

In the standard condition, students were not given this 
foiewaining. After the students read the passage, both groups 
were asked probed questions* The results of this study suggested 
that while there were significant differences in the non-cued 
conditions, there were not significant differences betv/een the 
two groups in the cued condition. It appeared that while learning 
disabled students did not spontaneously use comprehension 
monitoring strategies, when cued, they were able to do so 
effectively. There were no significant differences between the 
performances of the normally achieving students in the two 
conditions . 



ERLC 



♦Kavale (1980) gave learning disabled and normally achieving 
students, matched on grade level, 40 multiple choice questjcr.i 
(cause and effect, verbal reasoning, inference and main idea) and 
asked the students to "describe aloud the reasons for accepting 
or rejecting each of the possible choices" (p. 39) Kavale 
analvzed the results and found that the students reported seven 
distinct reasoning strategies. When he compared the reports of 
the two groups, Kavale found that the learning disabled students 
frequently did not report a strategy (20% of the time) and that, 
when a stratecv vvas reported, the students often named strategies 
that were not particularly effective - that is, that led to few 
cor r ect responses • 

In another comprehension monitoring study, Taylor and 
Williams (1983) asked learning disabled and normal elementary age 
students to identify text inconsistencies and reported that, when 
students were matched on I,Q. and reading vocabulary, there were 
no significant differences between the two groups, (Both groups 
also displayed similar success in identifying main ideas). 

In the reiTiaining three reading strategy studies (Clarke 
Deshler, Schumaker, Alley and Warner, 1984; Schumaker, Deshler, 
Alley, Warner and Denton, 1982; Wong and Jones 1982), researchers 
explored this hypothesis by focusing on the effect of teaching 
learning strategies. 

Instructional Studies. Clark et,al. (1984) taught a visual 
in*agery strategy and a self-questioning strategy to secondary 
learning di'abled students. To learn to use visual imagery, 
students were taught to lead the first sentence and to create a 
visual image of the content of the sentence. Students were then 
told to describe their image. If they could not make an image, 
they explained why they could not and tl en went on the the next 

V 

Do 
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sentence. If they could make an image, tbey weie told to "decide 
if is the same as an old image..., the old inage changed somewhat 
or an entirely new image" (p. 146). They weie then instructed to 
check their image for completeness. This pattern was repeated 
throughout the stpry. 

Self questioning was taught by having the students ask and 
answer their own Wh- questions as they read« The researchers 
found that the learning disabled students were able to master 
both strategies with relatively little instruction (2 to 4 hours 
per strategy) and that students were then able to apply these 
strategies both to ability level material and to grade level 
material. (The mean discrepency between ability level and grade 
level was 4.2.) Posttest scores on grade level material averaged 
81.7% (with a pretest mean of 45.0%) for visual imagery and 89.8% 
(pretest mean of 46.0%) for self-questioning. 

, Schumaker et.al.(1982) wanted to help students "gain 
information from cextbook chapters" (p. 235). They devised a 
strategy called Multipass which, once mastered, the students 
could use independently. The steps in Multipass, called passes, 
are Survey, Size-Up and Sort-Out. In Survey, the student reads 
the introductory paragraph, reyiews the table of contents to 
understand the relationship of the chapter to the rest of the 
book, reads the subtitles of the chapter to understand its 
organieation , scans the illustrations and reads the summary 
paragraph. 

In the Size-Up pass, students read the chapter questions, 
indicating with a check mark those questions for which they 
already know the answer. They then read through the chapter 
searching for clues to questions. Answers to questions are 
parathraaed as are all the fact^ and ideas the student can recall 
about the chapter. 

In Sort-Out, students test themselves on the chapter, using 
chapter questions. If a student can not answer a specific 
question, he/she is told to think of the section in the chapter 
where the answer would most likely appear and skim that section 
to find the answer. 

Schumaker et.al. (1982) report that learning disabled 
students wete able to effectively master this strategy and that 
their scores on content area chapter tests improved* 

Wong and Jones (1982) also investigated the effect of self 
questioning training on the reading comprehension of secondary 
students. These students were told to a) ask themselves why they 
were reading the passage, b) find the main idea, c) think of a 
question about the main idea, d) learn the answer to their 
question and e) "...look back at the questions and answers to see 
how each successive question and answer can p'tovide you with more 
information" (p. 231). Their results showed that students who 
received this training answered more compiehensicn questions 
couectly than did the untiained 'group. (Wong and ^>7ones also 
reported that the effect of training was positive for 
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non-leaining disabled students, although not significant •) The 
leseatcheis note that their results "do not i^ugges^t that l€-arning 
disabled adolescents have an ability deficit in ternis of 
insufficient r elcicoirpiehension skills (but) rather. ••Out findings 
are interpreted as having pinj/uinted another as£*ect of learning 
disabled students* cognitive and n^etacognitive inactivity vithin 
the domain of reading comprehension" (p. 238)* 
Research with the Learning Disabled; Processing strategy as 
doiPinant focus^ " 

Descriptive Studies. T.here are eight studies which have 
been coded witr. processing strategy as its dominant focus. These 
are generally correlational studies. Researchers want to 
understand the relationship- between leading con^prehension and 
oral language, oral reading behavior , knowledge of syntax, 
retellings or vocabulary. 

PflauiTi (1980) focused on the relationship between oral 
teaming behaviors and reading coutprehension. She asked 76 
learning disabled and non-learning disabled students to orally 
read a 30 word passage and then to retell the story, Pflaum 
concluded that when reading level and age were used as 
covariatesr oral leading behaviors could not be used to predict 
comprehension . 

Reid and Kreskc (1980) invent i<;ated the relationship between 
oral language and earl^ reading in both learning disabled and 
norrally achie\*irig students. Testing five, six and seven year 
olds, the researchers found that there was a correlation between 
oral language and eaily reading. Older students scuix^O higher. 
The scores of :>tudents labeled learning disabled students were 
not as high as their chronological peers. 

Hansen (1978) corrpared the retelling score*, of 34 fifth and 
sixth ijrade leaining disabled and normally achieving students 
with their conprehcTsion scores and found a positive 
correlation. 

Cartelli (1977), Jenkins, larscn, and Fleischer (1983), 
?any, Jenkins^ and Schreck (1982) and Pany and Jenkins (1978) 
wece interested in the relationship between word knowledge and 
leac'^ng comprehension. Cartelli (1977) found thet teaching 
paracigirat ic {associat icnl) language structures resulted in 
higher "scores on the Metropolitan Peading Test for 46 learning 
disabled priDar\ students. 

Jenkin3 et.al. (1983) est<^blished two txeatn^ent groups - 
word supply end drill. The results of thir study suggested that 
i-tuOer.tl* jLf the diil] condition hrtd higher comprehension scores 
on sentence rare exercises than those in the word supply 
t r eat rent . 

Pany and C^enkirs (1978) were interested in how word 
knowledge could be best acquired, i^Oative to irtiptoving rea^ixtf. 
conprehenL'icn. Four treatment conditions were established - 
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Deanings f»^on context, ireanings given/ meanings practiced and 
control. The reieaihers found tl£»t vocabuluri km w3 edge va.v 
helpful in helping students recognize and give synonyms foi 
target words in sentences, but that there was not a correlation 
betveen treatment and scores on factual recall questions. 
Vocabulary knowledge did not appear t< affect passage 
coiripxehension. In 1982, Pany, Jenkins and Schreck established 
the san^e four tieatnent groups and concluded that vocabulary was 
useful in sentence comprehension but not effective in iruproving 
cloze scores or in retellings. It was suggested that either 
different t^pes of vocabulary training might be needed for prose 
coiT:prehension or that 

The presured ir^portance of vocabulary kn"^wledge may 
}a\e been torewhat overestinfated. • .Perhaps readers can 
tolerate an unexpectedly high proportion of unfamiliar 
words without suffering comprehension Josses. This 
explanation seems particularly plausible if the reading 
passages are ones for which the students already 
possess well developed knowledge structures or 
schemata. faced with passages based on familiar 

themes, readers iray need only to detect sufficient 
fragments of information to recognise the theme and 
construct the authors intended meanings based on their 
own 'knowledge recipes' or schemata (Anderson, 1976). 
In any case, the presence of unfamiliar words in the 
current passages may not have resulted in the intended 
disruption of comprehension, {p. 214) 

White, Pascarella and Pflaum (1981) sought to investigate 
the relationship of syntactic understanding to reading 
ccnprehensior . The^ taught studentt> to combine single words into 
coherent sentences {anagram treatment) or to analyze sentences 
syntactically (sentence construction tr eati.ient) . They found that 
students in the ana^rar tjcdtfient had higher cloze scores on a 
passage fion Eoning's Getting the Facts than did students in the 
sentence construction treatment. However, "the greatest 
achievcr.:ent benefits associated with the anagram 
treatment .accrued to those students with higher initial reading 
ach iev crimen t . As level of pretreatment decieesed, the magnitude of 
the treatment differences also tended to decrease." (p. 697) 

Research with the yearning njfebled: Tasl^ dApr^inant focu^ 

Descriptive Studies. Ysseldyke, Thurlow, Mecklenburg, and 
Gxaden (1984) collected data or reading comprehension instruction 
in 34 regular and special educ£*tion classrooms. Similarities 
were found in time allotted to task (60.8 and 65.7 minutes per 
da\), and disti ituticin of that time (in lark r.ider: basal reader 
textbooks, worksheets, and workbooks). Both groups spenl 
c-:mila5 Mounts of time receiving i^mall group instruction and 
while the special education received 14 rore minutes of 
individualized contact (15,4 minutes for special education 
students, 1.3 for regular education), there was not a 
significant difference in the amount of instruction provided. 
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Regular education teachers spent laore time in ftovl of tie clasi;; 
special education teachers spent irore time at the side of the- 
student. Special education students received more teacher 
approval than regular education students • Host student time in 
both groups was spent passively although special education 
students spent more time reading aloud and discussing their 
course work. 

Leinhaidt, Zigmond, and Cooley (1981), involved observing 
ICS students in 11 classrooms for the learning disabled. The 
researcheis wanted to understand what classroom factors 
influenced leading comprehersit i iiaprovement . The researchers 
noted variation both in teacher and student behavior: while tl»e 
mean time for teacher instructional behavior was approximately 16 
minut^S/ som.e students received almost none of that time while 
others received almost 30 Canutes, SoL^i- ;^tudents spent as much as 
160 minutes of the day reading, while one spent none. 

Multiple regression analysis was used to understand the 
relationship between "how the activities the students engaged in 
affected their test performance and how a variety of 
instructional features influenced student behavior" {p. 352). 
Fron this analisis,- the researchers concluded that silent reading 
time significantly contributes to gains on reading comprehension 
measures. They noted that 

increase of 5 minutes per day would be equivalent to 
about one nonth {on a grade equivalent scale) of 
additional reading achievenent. (p. 355) 

Instruct ioral Studies; Programs. Cornelius and Semel 
(1982)^ Cox and Wilson (1981), Lovitt and DeMier (1984) and 
Stockdale and Crump (1981) focused on instructional programs. 
Cornelius and Semel (1972) found that the scores of students who 
received summer school instiuctJon did not regress as did the 
scores of those students not enrolled in suirmor school. Cox and 
Vfilson (1981) compared the reading achieveroent of students in 
three program structures; Ic-arning centers, regular classrooms 
with outside support and self-contained learning disabilities 
ciassrooris and found that the students receiving the 
individualized inibtructicn offered by the latter n*ade more gains 
than the students in the other two sljuctures. Lovitt and DeMier 
(1984) compared the gains made by students instructed by the 
Sullivan progic.n versus the Slingerland method and found no 
significant differences. 

Stockdale and Crunp (1981) followed the progress cf one 
student (labeled learning disabled) over a ftuir year tinie p€i.«r*d. 
The student began with an eT^hasis on phonics, switched to a 
sight wojd emphasir* and was tauyht with a "modified holi:-tic 
er^phasis" during the last year. The results; of their rtmli 
suggest that the student evidenced the r*':u*^t i :^ 2^*^-- whrn 1 c v/i;. 
ir the DOdified holistic nronram and that h»^^ "indicated a noio 
lositive altitude for the activity" [p.AVVf ^.ii i 
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instiuctional tin^e. The researchers desciibc tbJs £.109 lan ai* 
follows: 



During Lee*s first reading session, the LD specialist 
selected reading materials that were of interest to hiin 
and that contained predictab3e 3anguage, The books 
chosen were at Lee's instructional reading level in 
order to develop his ability to predict, confirni and 
integrate the information read, Lee selected a book of 
interest and as he read, the LD specialist encouraged 
him to ask the follovinu questions as suggested by 
Goodman and Burke (ji72) "Does what I am reading nake 
sense?" "Does it sound like language?" "What should I 
do if it doesn't make sense?" (p. 404) 

Based on the results of this study, Stockdale and Crump 
suggest that "teachers should encourage i>tudents to guess, to 
take risks and test their hypotheses. Student eriois should be 
regarded as cues they may employ to make sense of what they 
read." (p. 405) They further note that "a critical consideration 
in reading instruction for learning disabled studentc> is to rrake 
them aware that receding is language and that reading is 
meaningful" (p. 405) . 

Instructional Studies^ Modalities. Cook and Welch, 1980; 
Dubey and O'Leary, 1975; Punnett and Steinhower, 1984; and 
Wiseman, Hartwell, and Hannafin, 1980 investigated difference^, in 
modalities. Cook and Welch (1960) developed three tieatment 
programs: ai-ditory training ^Jus reading, visual training plus 
reading ard reading only. The two tteatment groups received 
training in their diagnosed deficit. For example. 

Students within the Auditory Deficit/Auditory Training 
gioup who showed deficits in Auditory Memory on the 
{Goldman-Fristoe-Woodcock Auditory Skills Test 
Battery) were given exercises from Developmental 
Learning Materials, Auditory Memory Prograru of the 
Auditory Perceptual Tiaining Prograu' or activities 
recomj^ended by Bush and Giles (1969) for auditory 
association or auditory sequential memory, {p. 78) 

The lei&eaich xc-port did not include a descri£.lIon of the reading 
instruction. After forty lourc-i of instruction, no i^ignif icant 
differences were rcted. 
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Dubey and O'Leary {1975) found that the two hyperactive bo:,, 
thei studied got no:e co^<prehension cjue^^tions correct when thC'> 
read orally instead cf silently. 

Punnett and Steinhower (3 984) pcovicl^^d r-ztler ocu1"ir 
trairing with or without r f-infoicement tn four ttidents. Tv^o 
<the: 5tudenti. ;:*erved as controls; these stuclonti. vote allowec^ It* 
play during the training sessions. The- jCM-aichers :eport that, 
as a result of training, the number of r^^jr ccr^ion::- decrees cd or 
did the number of saccades. Comprehensimi scores for the 
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treatment groups increased while scores foi the control group 
decreased, Punnett and Steinhower note that their stud^ provides 
"v;eak evidence foi the efficacy of vision training as a treatment 
for leading handicapped students" {pg.l9)* 

Wiseman et.al. (1980) compared the reading comprehension of 
50 secondary i^tudents labeled learning disabled and concluded 
that students generally did as well or better when listening than 
reading, but noted that there was great variability in individual 
perforipance* 

Instructional Studies; Rate, Dowdy, Crump, and V7e3ch {1582) 
conpaied the reading rates and comprehension scores of learning 
disabled and norinally achieving students at three grade levels 
and concluded that the learning disabled students had slower 
reading rates and lower compt eheiision scores. The researchers 
argue that learning disabled students "may be overly dependent on 
print and that the slow word processing rate may interfere with 
comprehension" (p. 260) • Dowdy, Crump, and Welch do not offer a 
hypothesis to explain this observation - although other 
researchers have suggested that print dependency is often an 
artifact of instruction and/or instructional materials* 

Instructional Studies: Rewards. -Three of the intervention 
:?tudies have offered extrinsic rewards to students for 
inprovement in reading comprehension scoiei- (Levitt and Hansen, 
1976; Roberts and Snuth, 1980; Swanson, 1981), Lovitt and 
Hansen (1976) found that allowing students to skip portions of 
the basal whenever criterion scores were exceeded and drilling 
when they were not, increased comprehension scores. In the 
Roberts and Smith (1980) study, eight learning disauled boye read 
five r.unufce£- daily to an instructor in three phases of 
instruction. In the first phase, students were told to read as 
fast as they could and not skip any words. The objective, it was 
explained, was to i ead iT«ore words correctly. In the second 
phase, students v.eie told to slow down and concentrate on reading 
each word coiiectly. They were encouraged to go back to correct 
errors. In the third phase, the students were told that the 
obj^K,tive was to answer the con»prehension questions correctly and 
to^do so would require reading all the wo^ds. Points and prizes 
were awarded c^. incentives in all three phases. The results 
suggested "when specifically targeted for chtinge, the target 
behavior (correct rate, error rate or comprehension) ir^iproved" 
(p. 64). Swanson (1981) reported that giving one-half minute of 
fceo tirr^e for every comprehension question answered coriectly 
likewise improved scores. 

Instructional Studies: Strategies. Idol-Haestras, 1983; 

Lindsey, 1980; Pascarella, Pflaum, Bryan, and Pearl, 1983; 
Pflauip", Pascarella, Auer, Augustyn/ and Boswick, 1982; Sachs r 
3983; and Sindelor, 1982 focused their research on the 
instructional strategies. Idol-Maestras (1983), for example, 
ised a "teacher-guided probing technique prior to r.tory reading" 
(p. 4). As described by the researcher, this strategy 
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included guessing general story content from the story 
title/ scanning the material for clues to general 
context as well as for difficult and/ox impoilont 
wordS/ determining the setting and deciding v/hether the 
story was fact or fiction (p.6) . 

The teacher was responsible for imp] en^ent ing each of the £*ix 
steps of the comprehension probe, Idol-Haestras found that 
students' comprehension scores improved durirg the instructional 
treatment/ but deteriorated after treatment was discontinued. 

Lindsei (1980) varied the purpose for reading and found that 
students who were told to read for specific cjoals had higher 
comprehension tjcores than those who were siir.ply told to read to 
learn all they could. 

Pascarella et.al. (1983) tested students to determine 
whether they were low or high in internal attribution for effort 
- that is, whether the^^ saw themselves or others as responsible 
for their learning successes and failures. The researchers then 
established two treatment conditions: teacher determination of 
error and student determination of error. Both groups received 
instruction "on error awareness and determination of error 
seriousness for using sentence meaning to decode" {p. 292) . In 
the teacher determination of error treatment, teachers were told 
to "clearly state to a student whether his or her response was 
correct and what a correct response was if incorrect" (p. 290). 
In the student determination of error condition, "teachers were 
directed to encourage students to find out for themselves when 
thev identified errors as serious and whsn they made good guesses 
while learning to self-correct" (p. 290). The researchers 
concluded that students who felt that Li.e responsibity for their 
learning resided with someone other than themselves benefited 
more from the teacher determination of error condition and that, 
conversely, those who saw themselves as responsible for their own 
learning benefited more from the student determination of error 
t recitment . 

PflauiT eir.al. (1982) studied the effects of four 
comprehension facilitating conditions on learning disabled and 
normal elementary students. The four conditions were word 
identification and meaning aids, sentence aids, purpose-setting 
aids and prior knowledge aids. They reported that sentence aids 
were most effective for learning disabled and similarly 
achieving, but younger readers. The authors suggest that 

perhaps the most important result ...is the finding 
that LD students responded no differently to the 
comprehension aids than did younger, nondisabled 
children reading at the same proficiency level... (and 
note that) it may be that children acquire greater 
flexibility and ability to respond to textucil and 
beyond the text information as they advance into 
reading proficiency levels beyond the primary grades. 
(212) 
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Sachs (1983) provided thiet types of instruct ion. Jr tlie 
fitst 9toup, students coinpieted worksheets and di^^cu^i^ed thcii 
answers with the teacher; in the second yioup, a modified 
Directed Reading Activity was used, students discussed the te:<l 
rrd nade predictions about whet would happen next. The third 
yioup generated examples which* did and did not illustrate the 
central concept of the story. Concepts were defined by using 
examples and non-exaniples, Sachs found that the 3itera]/ 
infeiertial, evaluative and appreciative conipr ehensicn of the 
students was tetter in the latter two treatnients than in the 
vvuiksheet condition. 

Sinde3ar (1982) considered the person (s) doing the 
instructing as well as the strategy being taught. He devised 
four groups, three of v;hicl weic peer tutored. The peers taught 
either an oral reading, a word recognition or a hypothesis test 
strategy. The teacher taught the hypothesis test n^ethod. The 
hypothesis test nethod was based on the strategy used by Samuels 
1974 (reviewed fr tl"u laper in the section "Reading 
coir.prehensicn lesearch with the Mildly Mentally Handicapped"). 
Sindelar's research reports that the hypothesis test method was 
the most effective and that students in the hypothesis test 
treatnients did ju:^t as well with peer-tutois cs did they did with 
teacher instruction. 

SYIiTHESIS OF FINDINGS 

Synthesiiiing acioss the studies v;e find that comprehension can be 
p roved by 

1) Accessing and, as necessary, developing ischeinata. Thi^» 
Includes schen^ata for the content, the tas. , ar.c' the copLe:;<tt in 
which the task cccurs as well as for the type and structure of 
the text. Defined as such, shen:ata includes strategies. Many of 
the activities that develop schemata are those that have as one 
of the:: objectives getting the student actively invoJved. (See 
Eos and Filip, 1984; Eos and Tierney, 1984; Clark et.al., 1984; 
r.indsey, 198C; Pe] eg and Moore, 1982; Sachs, 1983; Schumaker 
et.al., 1982; Stockdale and Crump, 1981; and wong and Jones, 
1982) 

2) Using a]l the clues available in the linguistic, sociai c,nd 
cultuxa] context. (See HcGill-Franxen and Gormley, 1980; Robbins, 
1583; Saniuels <•^.•Il., 1974; and Stockdale ond Crunp, 3 981) 

3) Developing flexible strategies that can be applied in a 
varitrty of situations. (Sec Clcirk et.al,, 1984; Samuels, 1974; 
Schuitfakei, 1982 and VJong and Jones, 1932) 

TMPMCATTONS FOP n^STPUCTIOh 

There seem to be four majot imp! U^t /r.pr fit tho^c ccncerrcd vilh 
effective reading comprehension instruction f f ^ ^i»'cio3 ed'jCutJ<»i* 
L^tudents. The first i^^ that instructMu* r.u< irti-tmct icnrr 
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piogiaiu liocC to incorporate the insights about scheniatd/ 
content:; auo itiuteyy developiuent . 

The second 1l that assuniptions nov/ held need to be 
ic^cxomined . Vian-j uf the research results (Bos and Filip, 1984; 
Scbuir^akei et.al., 1981; Taylor and WilJiams, 1983; Wong and 
Jones, 1982} ^u^^e^^t that students labeled learning disabled may 
be as cognitiveij capable as their non-labeled peers, that is, in 
teirt of academic tasks, they may be learning inefficient rather 
than learning deficient. The Bos and Tierney (1984) study 
-.^^9e3ts that student i.. labeled Mildly Mentally Handicapped may be 
jL^ capable cf drawing inferences as their non non-labeled peers. 

The child injplication is that teachers should become 
researchers in their own classrooms. The lesearch has sugges-t^d 
strategies that work for some students in sorae conditions; 
teachers need to try out under real ciassioom conditions, 
strategies that have appeared to be successful under research 
conditions. This call for teachers to become researchers is one 
of the stiL^ngest needs that has emerged froir our research. Only 
as teachers become researcheis can the goal of providing 
effecti^*<- :cccirt«3 :nst!uction for every student be realized. (For 
fiitber explieatior, see Chapter 9 - Teachers as Explorers: 
Teccher Researchers and Present Research Needs) 

Tl*e fourtl- ii-i 1 5cot- jc.** is that strategies found successful 
Lv>th the handicapped and the non-handicapped should be 
aL-lj.:-ed with handicapped learners. The strategies that have been 
tried and found apt^i-^ntly successful for students vith 
xundi^c£pii^ .^viiCIlions are some of the same stiategies that have 
teen foi.rc* . vc< r.r*ful with their non-handicapped peers. (NB: The 
cnZ\ except ion ic Barber 1983. Her results: that illustrations 
had a detrimental effect on the reading scores of 3r-arning 
disabled students in the middle and high groups, is in direct 
ci.'r't- 1 adiction tc the tesearch on the effects of illustrations on 
the compretien^icn of non-labeled students. That research suggests 
that i 1 lust lat ionc which support the text (that is, provide 

pleirento^i ralhvi than conflicting inforniat ion) enhance the 
itudei't.^ comprehension. As the Harber (1983) finding has 
v^eneiated much controversy, teachers are advised to withhold 
;,.cl^j orient untiJ iley have had the opportunity to research this 
JiirUt :r then own classrooms or until otheis have done so.) 

It ^ticvi. i^w^oible that what is effective for one population 
rrav al^f. ce effective for the other. Chapters Six and Eight 
explicit ii OMlIir.^ cone the the strategies found successful with 
non-l»rii c^Jc capped >ainers: Chapter Six focuses on thinking 
watiategieo and Cha^.tei Eight on strategies used in exemplary 
ctutiie::. Zli ohuit that follows summarizes the findings of the 
i^'pecial education reading comprehension research. 
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Table 1 

Pindinqs: Special Education Reading Comprehension 
Instructional Strateg: es 

I. POSSIBLY hELPFUL: 

Advanced organizers (develoring and accessing schemata): 

Peleg and Moore (1982), p.3 
Context: Mc-Gill-Franzen and Gormley (1980), P.obbins (1983), 

P-5 

Continuous instruction (supinei school): Cornelius and Semel, 

(1982), p. 12 
Cuing: Bos and FiTip (3984) , p. 7 

DRA/CAA: Sachs (1983), p. 14 

Hypothesis-test (contextuaJ cDues): SaiBuels et.al* (1974), 
p. 3 

Individualized instruction (resource room/self-contained): 

Cox and Wilson (1981), p. 12 
Modified holistic prograio: Stockdale and Crump (1981), p*12 
Multipass: Schunaker et.al. (1982), p,8 
Peer tutoring: Sindelar (3S82), p,14 
Pre-reading strategies: Idol-Maestras (1983), p. 14 
Purpose setting: Lindsey (1980), p. 14 

Regards: LovitL and Hansen (1976), Roberts and Smith (1980) 

and Swanson (1981), p. 14 
Self-questioning: Wong and Jones (1982), p. 8 
Silent reading: Leinhardt et.al. (1981), p. 11 
Visual imagery and self-questioning: C3ark et.al. (1984), p. 8 

II. AMBIGUOUS: 

Anagran.b: White, PascarelJa and Pflaum (1981), p. 11 
Auditory and visual training: Cook and Welch, p. 13 
Illustrations : Horber (1983), p. 6 
Listening/reading: Wiseman et.al. (1980), p. 13 
Ocular training: Punnett and Steinhower (1984) , p. 13 
Oral/silent reading: Dubey and O'Leary (1975), p. 13 
SlingerZand/Sullivan: Lovitt and DeMier (J 984), p. 12 
Student/teacher determination of error: Pas-carella et. al . 
(1983), p. 14 

Vocabulary: Pany, Jenkins and Schreck (1982), p.lO 

IMPLICATIONS FOR RESEARCH 

General ImplicationG . The obvious and general implication is 
that more research is needed • As has been mentioned, there 
simply is very little research that has been conducted with 
sti dents labeled as handicapped. In additiun, the reseorcl that 
has been done is often in discrete areas; there is, for exaruplo, 
only one advance organizer study. Hypotheses that have been 
generated by the existing lesoarch nc-ed to be confirned oi denied 
bi additional studies. 
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Generated Issues. In addition to this generc] reed for more 
research, there is a need for research that addresses some of the 
questions raised bi' the existing studies. The questions and the 
studies that generated them are as follows: 

1) Do handiccfped students have the same cognitive capabilities 
as non-handicapped students? 

The Bos and Filip (3984) study concludes that students 
labeled learning disabled are able to utilize effective 
strategies when externally cued to do so. The results of the 
reward studies (Lovitt and Hansen, 1976; Roberts and Smith, 1980 
and Swanson, 1981) suggest that, given external reinforcement, 
this same population of students successfully complete academic 
tasks. If this is so, and it is assumed that all behavior is 
rule governed, what are the rule systems 3 earning disab]ed 
students employ in their approach to academic tasks? 

The Bos and Tierney (1984) study suggests that students 
labeled HiMH aiQ as capable of generating inferences are as 
non-handicapped peers. If this is so, what are the implications 
in terms of further research and in terms of instruction? 

2) Are there differences - cognitive or otherwise - between 
students who are labeled poor readers and those who are labeled 
learning disabled? If so, what are those differences? If not, 
what are the implications for instruction? 

Pflaum et.al. (1982) investigated the effectiveness of four 
coirpr ehension strategies and found no differences between 
students when they were matched on reading level. 

Taylor and Williams (1983) matched students on I.C* and 
reading vocabulary and found that both groups of learners 
(learning disabled and normally achieving) were equally 
proficient at identifying text inconsistencies. 

3) How much of what is perceived as innate differences in 
processing strategies is an artifact of instruction (methods 
ar»d/cr materials)? 

In the Bos and Tierney (1984) study, it was implied that the 
students labeled Mildly Mentally Hr.iidicapped had less opportunity 
to develop schema for expository text. How much expository text 
IS read ir» special education classrooms and liow does that compare 
with mainstreamed classrooms? 

Dowdy, Crump, and Welch (1982) suggested that students 
labeled learning disabled were overly dependent on print. How 
Hiuch special education instruction is meaning based rather than 
phonetically based? Do the materials used in specie! education 
classrooK' focus on small meaningless parts of speech and short 
excerpts or whole, longer meaningful texts? Is this ratio 
similiar in regular classrooms? 



LANDSCAPES: SPECIAL EDUCATION 



5:19 



Kavale (1980) found that learning disabled student£=. 
^ui-f*tir*es did net report a strategy and when they did, :t ^-p^s 
cften one that led to incorrect ansv;ers. How much opportunity and 
support do learning disabled students have to e>pcii:;ent with and 
to develop a variety of learning strategies coiPpared to the 
opportunities thd students receiving non--handicapped instruction 
have? 

4) What is the effect of giving students more opportunities to 
read silently in the classroom? Is it true that 3 earners learn 
to read by reading? If so, what are the implications in terms of 
reading r«ethodologi ? 

Leinharc't et.al. (1981) found that silent recKUng increased 
leading comprehension test scores* For every minute of daily 
additional reading time, post test performance jnproved one 
point . 

5) Is it true that task-specific, teacher-centered strategies 
have little long t€ir. c-f f ectiveness? Is the opposite true- that 
generalizable, student-centered activities, where students have 
the optortunity tu take ownership of the task, are mere effective 
in the long teriu? 

Idol-Kaestras (1S83) used a teacher guided probing 
technique; comprehension scores deteriorated after treatment was 
discontinued. 

Clark et.al. (1984) taught the students a visual imagery 
strategy that could be used with content aiea materials. The 
itidents' scores improved wl only on the measurement designed by 
the researchers, but on content area tests as well. 

Schumaker et.al. (1982) taught a version of SQ3R which 
students were able to appJi f-ffectively to content area 
naterials. Scores on content area tests continued to improve 
after treatment was terminated. 

CONCLUSIONS 

If what we have after 15 months of lOsearch, and what you have 
after more than twenty pages of leading, is an additional r^et of 
c^uestions rather than answers to our original questions - Vlas 
this experience worthwhile? o\vr resounding answer is "Yesi". 
Through this experience, we, as \researcherF , have come to 
understand what it is we do not know. We have learned what 
questions to^^^ask. We can only hope that you, the readers of this 
text, will fcin us in searching for the answers. Our motivation 
is fairly straight foiv/ard - there are a lot of students whose 
lives will be bettor whcr we Lave the answers. This Uindscape has 
been uncharted long enough. 



ERIC 



107 



Chapter 6 



A NEW LEWS FOR THE LEARNING DISABLED: 
A COGNITIVE APPROACH TO READING 



Katharine Mitchell Busch 
California State University - San Bernardino 



INTRODUCTION 



In the sunimer of 1984, as we discussed the content of our proposed synthesis 
papers, we wondered what the classroom teacher would want to know about the 
current "state-of-af fairs" in conprehension research. We decided to survey both 
special education and general education teachers, in various parts of the 
country, to find out firsthand what they would like to Know from the research we 
were reading. 

Some of the replies from our query were: "Hew can I get my kids to read and 
understand better?" "What study skills are most useful?" "What can I do to 
help the 'different' kids - those students who are not succeeding?" 

With those questions in mind, I began to look for trends in research that 
would have implications for the teacher in th** classroom, particularly the 
teacher in special education. In addition, I gleaned instructional techniques 
from both reading and special educaton journals which could provide a new lens 
from which we could view instructional practices. 

My first objective in this paper is to review the contributions from 
cognitive psychology in describing ho^ children "come to knew" and to discuss 
two intervention models, one developed by researchers at the Center for Reading, 
University of Illinois, and the other by researchers at the Kansas Insititute 
for Research in Learning Disabilities. The first intervention system is a 
social interaction model which focuses on "self-regulation" training; the 
second, a "teacher-generated" intervention model in which the student learns a 
"set of procedures" to learn content iraterial. 

My other purpose is to share with you a range of instructional strategics 
which has, as its theoretical foundation, findings from cognitive and 
developmental psychology as well as from the field of reading and learning 
disabilities. This is a "starter" set of strategies for those teachers 
interested in taking a cognitive approach to reading instruction in their 
classrooms. I refer to some of these as "comprehension-monitoring" strategies 
and others of these as "schena-building" strategies. 

I will address these purposes in three seccions. In the first section/ I 
will review the contributions of cognitive and developmental pschology to the 
field of learning disab:lities. Specifically, I will present the learning 
strategy model proposed by Brcwn (1982) and discu^as the influence of Vygotsky's 
work in the development of Brown's intervention model. In the second section, I 
will review the implications of this work for curticulum by reviewing Brown's 
instructional model as well as the model developed by Deshler and his associates 
(1984) at the University of Kansas. In a third section, I will present a series 
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of instructional strategies. These instructional strategies evolve from the 
literature and are my attempt to give teachers the kinds of practical help that 
our sur\'ey indicated they were seeking. 



An Overview of the Issues 



'^eta cognition, cr knowledge of one's cwn cognitive system, has become the focus 
cf reseach on children identified as learning disabled (Hall, 1980; Loper, 1980: 
Torgesen, 1977; Wong, 1979). Hagen, Barclay & Newnan (1982) suggest that a 
significant reason for this trend is that metaoognition is considered a possible 
explanatory construct for why so rtany children experience difficulties in 
certain academic settings. The interest in this perspective has been heightened 
because, if learning disabled children can be described as "different" in 
certain me ta cognitive aspects of problem-solving, then possibly these 
-iifferences can be remediated through instruction in metacogiUtive techniques. 

The recent interest in the cognitive processing behaviors of learning 
disabled students emerged as investigators attenpted to explain why these 
students seemed to respond differently from normally achieving stuients in the 
Bcadenic setting. Traditionally, learning disabled chiliren's academic problems 
3nd poor performance in experimental tasks were explained in terns of specific 
ability deficits ('"ruickshank & Hallahan, 1975a, 1975b; Torgensen, 1975). That 
is, these children experienced an inability to function effectively in the areas 
cf visual and/or auditory perception, visual and/or auditory memory ,^ mDtor 
abilities, language, and so forth. Hcwever, as researchers were successful in 
changing perforrranoe of task through brief instruction or pronpts, a "production 
deficienci' in appropriate strategies rather than a specific deficit aK>eared to 
best explain the j^rfornance difference of these inactive learners" (Wong, 
1^82b}. These insights initiated a changing perspective of disabled learners 
which seemed to be a more functional view, suggesting that: 

these students had knowledge that they had failed to access under 
certain circumstances, or had strategies they had failed to use, or 
they had failed to learn under what circumstances certain strategies 
were useful because they helped to monitor one's progress (V?ong, 
1982b). 

Brawn i» Campione (1981) refer to this perspective as "diagnosis of restricted 
access."* This new direction, examining the cognitive processes and the nature 
of participation of the learning disabled child in the academic setting, has 
uci^inated the learning disability literature ..n recent years. 

In response to the suggestion that learning disabled children seemed to 
exhibit an inability to adapt to various learning situaticns, recent 
investigations have pursued this notion. Several researchers, (iMcKinney 6r 
Fe^gans, 1981: Md-eskey & Cunmngs 1982; Palinscar fir Brown, 1983) have outlined 
various cognitive behaviors of learning disabled children and have concluded 
that "further study of LD as a problem-solving deficit is needed to provide 
insights into the instructional practices necessary for teaching the problem 
solving process" (McLed^ey & Cummings, 1983, p. 20). They concurred, however* 
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that learning disabled students often fail to acfept an active, planful/ and 
organized approach to learning tasks. 

While research conducted recently provides convincing evidence that 
learning disabled children as a group do not spontaneously engage in certain 
organised goal-directed strategies that aid perfornanoe on intellectual tasks, 
training studies indicate that they can employ these strategies if taught to do 
so (Wong, 1978, 1980} • These findings suggest that nore participation can be 
generated through an interactive curriculum by teaching a system of strategies 
which demonstrate patterns of organization to this population. 

Theories of infornation processing from developmental and cognitive 
p^'chclogv' have provided a powerlul inpetus for research investigating the 
cognitive processing of students labeled learning disabled. In the next section 
the psychological underpinnings of these projects will be discussed. 



COiNTRTBim oraS FROM PQCA^ITIVE PSYCHOLOGY 



The work of the cognitive psychologists in the late sixties and throughout the 
seventies led to a fairly detailed description of hew children acquire academic 
skills and come to know how to learn (see Brown [1977, 1979] and Bransford 
ri9793 for a more detailed account of this process). An overview of the 
learning model that has been adapted by Brown (1982) from Bransford (1979) and 
Jenkins (1979) is reproduced to illustrate their views concerning the nature of 
the cognitive process (see Figure 1). 

The diagram is intended to represent the learning situation, that is, the 
learner in context. According to Brown, there are four factors that oonprise 
the leamer~in-^2ontext, and these factors interact in rr^ny corrbinations. The 
four factors are: 

(1) certain characteristics of the learner including his/her capacity 
and state of prior knowledge: 

(2) the nature of the naterials to be learned: 

(3) the critical task, that is, what end product is required for the 
learner: and 

(4) the learner's activity. 

The nodel attempts to capture the notion that learners vary in what they kiK^ 
and what they can do and these factors influence hou they learn. 
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Figure 1 

A Simple Learning Model: An Organizational Framework 

For 

Exploring Questions About Learning From Texts 
(Adapted from Jenkins, 1979, Bransford, 1979) 



Characteristics of the Learner 



/ 



Skills, Knowledge, Attitudes? 

Activate Available Knowledge? 

Reason by Analogy, etc.? 

Memory Limitation? 
Test/Text Anxiety? 



Learning Activities 

Strategics; Rules, 
Procedure 
Attention y 
Rehearsal \ 

Monitor Coruprchension, 
Elaboration 

Macrorules, etc- 




Criterial Tasks 

Gist vs. Verba t ion Recall* 
Recognition 

Generalized Rule Use, 
P rob 1 cm-so 1 v ing 

Resolving Ambiguities, 
Integrating 
Sun^narizing 

Following Instructions, etc 
Transfer 



Nature of the Materials 

Text Structure (physical/psychological) 
Logical Content, Interpersonal Content 
Coherence/Cohesion 
Sequencing 

Author's Explicit Meaning/Attitudinal Cues 
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The Leamer-in-Context Ncticn 



3rown*s organizational framework for exploring questions about learning 
suj^rted her earlier thesis (1979) that the developing child should be seen as 
a whole person, since learning involves and confines nany areas of personality 
d?velopnient previously perceived as separate such as fear of failure, need for 
achievement/ external versus internal control/ learned helplessness/ and level 
of aspiration. She placpd/the learner interacting in the center of the 
tetahedral with the elefWts of the learning environment with different degrees 
of enphasis/ depending \m the learning situation. 

A broader view of the leamer-in-context notion which included the whole 
environment as well as the whole person was proposed by r^eisser {1976a/ 1976b). 
He argued that: 

.•.there were three aspects to cognitive processing. First/ hunan 
thought undergoes cognitive development. It has a co^rplex cytogenetic 
history/ in which maturation/ learning/ and changing opportunities for 
experience/ all play a part. Second/ hunan thinking is passionate/ 
emotional/ influenced by internal states that have both long and 
short-run dynamics of their cwn. Finally/ hunan beings have nany 
motives simultaneously. They may play chess to bolster their egos/ 
fcr aesthetic pleasure/ to iraintain a personal relationship/ and to 
symbolize unconscious wishes all at once. All three of these 
qualities arise because people develop and use their cognitive skills 
in a real environment: they are always in concrete situations with 
multiple opportunities (p. 140). 

Neisser's inclusion of "conplex ontogenetic history/" enotions and 
feelings/ multiple natives, changing duration of dynamic states in the cognitive 
process/ and cognitive skills being developed in a real environment moved the 
reasoning process beyond the academic environment to include the child's 
culture. This enconpassing view of cognitive processing provided a broader 
interpretation tc the "state of prior knowledge" than was suggested in Brown's 
rodel of learning aciipted in 1382. However/ her recent researdi (Baker & Brown/ 
1384) indicated that she, too, views the learner's prior knowlec^e to include 
experiences other than those related to academic prior knowledge. 

The emphasis on the active role of the infoniatioo processor leads to the 
idea that learners actively construct meanings from their texts and from their 
environment/ and more inportantly/ that learners are responsible for their own 
learning (Reid & Hresko/ 1981). This learning process involves a set of 
j^rocedures an3 learning activities such as attention and recognition/ rehearsal 
and recall/ elaboration and problenh-solving. These aspects of the learning 
process are incorporated in Brown's learning model under the categories of 
criterial tasks and learning activities. Using the current terminology in the 
literature today, these components are referred to as metaoognition. 
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Understanding Cognitive Development 



Knowledge in general is seen both as a product or integrated collection of 
factual information and a process or set of procedures for knowing. This 
concept is referred to in the literature as inetacognition. Flavell (1976), who 
has been influential in the current research in this area, defined metacognition 
as "knowledge that takes its object or regulates any aspect of any cognitive 
endeawr" (P. 4). Metacognition involves two components: (1) an awareness of 
what skills, strategies, and resources are needed to perform a task effectively, 
and (2> the ability to use self -regulatory mechanisms during an ongoing atteirpt 
to learn or solve problems. These activities include planning one's noves, 
evaluating the effectiveness of one's ongoing activities, checking the outcoire 
of one's efforts, and revising strategies when necessary (Baker, 1982; Baker & 
Brown, 1984: Brown, 1980: Brown & Campione, 1979), 

A reoccurring theme that is pursued in the learning disability literature 
explores the differences in problem solving strategies of nornally-achieving 
students and those students labled LD. Learning disabled students are seen as 
less active in invoking activity such as rehearsal because they are less 
intrinsically motivated to perform well or to expend effort on various tasks 
both in and out of school (Henker, Whalen S Hinshaw, 1980: Wong, 1980). 
Torgesen (1977) noted that learning disabled children seem to lack an ability or 
an inclination to develop and use efficient stcategi ^s. He suggested that "both 
the cognitive and emotional characteristics necessary to a^pt to the 
requirements of a task end to use active and efficient task strategies" ney be 
lacking in the LD child. This change of lens provided a new focus in the recent 
directions of research conducted in the ar« ^ of ireta cognition. 

Baker & Brown {1984; noticed this changing of lens and have observed that 
researchers have moved from examining "how, when and where students have 
difficulty studying to an enphasis on interventions designed to overcome 
problems" (p. 38C). The authors suggest there are three aspects to the current 
reseach on metacognition: (1) the attention to the metacognitive environment in 
which the skills are trained: (2) adequate diagnosis of the learner's needs; 
and/ (3) training in the context of reading with the goal of understanding and 
remeiriering (p. 381), 

Citing their own research as evidence. Baker and Brown argue that 
successful cognitive skills training must include three components: (1) skills 
training? (2) self-regulation training: and (3) awareness training. They 
propose that diagnosis is an important ingredient which provides for interaction 
between the teacher and student and they have developed much of their recent 
research on Vygotsky's theories of self-regulation. 

The conponent of self-regulation and diagnosis reflected Vygotsky's views 
on guided learning within the student's "zone of proximal development" 
(Vygotsky* 1978) which addresses the student's learning process. Vygotsky's 
(1978, p. 86) definition of the zone of proxinel development is "the distance 
between the actual development level as determined Ir/ individual problem-solving 
and the level of potential development as determin»5 tlitourjh problem-solving 
under adult guidance or in collaboration with mor»? ca£^ble peers." Vygotsky 
argues that all psychological processes are initially social, shared between 
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Deople, particularly between child and adult, and the the basic interpersonal 
nature of thought is transforrod through experience tc an intrapersonal process. 
Vygotsky wrote: 

We propose that an essential feature of learning is that it creates 
the zone of proxirral developnrent; that is# learning awakens a variety 
of developmental processes that are able to operate only when the 
child is interacting with people in his environment and in cooperation 
with his peers. Once these processes are internalized, they become 
part of the child's independent development ac±iievement. (Vygotsky/ 
1978, P. 90) 

Vygctsky saw social interacticHis among teachers and students as well as 
instruction in formal school disciplines as central tc children's aoguisition of 
knowledge and self-regulatory skills. According to Vygotsky, as students 
acquire new knowledge, they also acquire routines for regulating and controlling 
their use of that knowledge. Self-regulation ocajrs only after studeiits 
perceive the significance of structural relations anong concepts and only after 
teachers have verbally mediated and guided students' use of concepts for 
extended periods cf time. From these mediated learning experiences, students 
eventually acquire language for regulating their cwn learning, and they do so by 
reconstructing in their cwn minds the speech or language forms t^^achers use to 
teach them (Wertsch, 1979- Vygctsky 1979). 

A major form of cognitive development is, then, the gradual internalization 
of regulatory skills first experienced by the child in social settings 
{Vygctsky, 1978). Through repeated experience with experts who support, 
evaluate and extend the limits of experience, children develop skills of 
self-regulation. 

Saker & Brown (1984) have seen a trend in current research from 
experimenter-controlled, cr teacher-controlled, instruction of the traditional 
kind towards a concentration on interactive processes. "It is throu^ 
interaction with a supportive, knowledgeable adult that the student is led to 
the limits of his/Tier own understanding. The teacher does not tell the student 
what to do and then leave the child to work on unaided; she enters the 
interaction where the child and teacher are mutually responsible for getting the 
task done. As the child adopts more of the essential skills initially 
undertaken by the adult, the adult relinquishes control" (p. 382). Examples of 
teacher-student interactions using Vygctsky 's theory of "guided learning" will 
be given in the curriculum section of this paper. 



Instructional Irnplications 



While developments in cognitive psychology have had an inpact on reseach 
concerned with the learning process and learning disabilities it has also been a 
factor in the area of reading corrprehension. Pearson (1982) sumrarized the 
cognitive oriented research of the 1970s with its inplications for reading 
comprehension and noted two najor conclusions. The most basic conclusion, 
according to Pearson, is that reading is a conplex interactive process 
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{Runelhart/ 1977: Stanovich/ 1980): 

-..one in which a reader varies his focus along a continuum from 
primarily text-based processing {concentration on getting the author's 
message straight) to priirarily reader-based processing {concentration 
on predicting what the author's message will likely be).. .(p. 81). 

He explains that this variation in focus is determined by a nuirber of factors: 
reader purpose/ interest and motivatico/ and discourse type and conplexity. The 
second conclusion drawn from this research is that both content and process 
factors are inplicated in reading conprehension. Content factors are the 
knowledge structures residing in our long-term seiTsntic memory that determine 
hcM well we understand and integrate a particular text. That is, the mDre we 
know about a topic addressed in the text, the greater the likelihood we will 
understand/ integrate and remember the information contained in the text. 
Another type of content that influences comprehension is knowledge about text 
structure or text genre in which the topical knowledge is embedded. The work on 
story structures (Neilsen, 1977; Stein & Glenn, 1979: Thorndyke, 1977) and 
typical rhetorical structures found in expository writing (Meyer, 1977; i'^eyer, 
Brandt & Bluth, 1980) indicates that familiarity with structure influences 
coirprehension . 

Harste, Burke and Woodward {1981) have provided a wider lens on the reading 
and writing processes suggesting that learning is a socio-psychclinguistic event 
in which the learner uses all of his/her knowledge about the world (schenata), 
knowledge about culture, knowledge about language, and knowlec^e about the 
context of situation to nake sense of the environment and in the development of 
literacy. Rather than viewing the reading process as interactive, they 
incorporate the notion of reading as a transaction (Rosenblatt, 1979) in which 
the reader creates a "new event" in each encounter with the text. 

Goodnan (1982) underscores the need to include the affective dorain when 
working with "readers in trouble." He has proposed that the key to helping 
readers in trouble is to help them revalue themselves as language users and 
language learners, and revalue^ the reading process as an interactive, 
constructive language process. He feels that those students must set aside the 
pathological view of themselves, cast off the labels, and cerate to construct 
meaning through written language using the strengths they have built and used in 
making sense of oral language or sign. " Goodnan views reading as a 
psycholinguistic process in which thought and language interact as the reader 
builds meaning. 

Evidence from research in cognitive psychology and reading have direct 
inplications for instruction in the classroom. In the following section, 
intervention programs found to be effective in the research paradigm will tx? 
generalized to the classroom. 
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(^RRiaJLAR IMPLICATIONS 



An inportant corollary to the identification of learning disabled students is 
tne development of instruction which facilitates their learning. The evidence 
generated from research in reading/ cognitive psychology and the field of 
learning disabilities is that the learner must be actively involved in the 
learning process and that instruction must be meaningful* Much of the evidence 
from current research support the notion of "restricted access" to acquired 
Knowledge (Brown & Cairpione/ 1981) and investigators have used strategies which 
have proved effective m helping learning disabled students nonitor and evaluate 
their learning. 

In the field of learning disabilities, two approaches in the development of 
intervention models have been pursued. In both intervention systems, the 
students were taught how to learn rather then concentrating on content 
infcrnBticn. In each situation training incorporated academic tasks in an 
academic setting. One cf these studies has been in progress several years at 
the University of Kansas Institute for Research in Learning Disabilities 
(Deshler/ et. ai./1981; Schumaker, et. al* , 1983). The najor mission of this 
team has been the development of an intervention curriculum that was powerful 
enough to affect the perf orrrance of learning disabled students in school 
settings. These researchers developed a curriculum conprised of strategy 
training, social skills, modified materials, and instructional procedures. They 
reported the ultirate goal of this group was to develop an intervention program 
so that most responsiDility for learning was placed on the stu<fents (Schumaker 
et al. , 1983). This approach was designed to teach students "how to learn" 
rather than teach students specific content. 

Deshler and his associates reported that the core component of the 
intervention model utilized the learning strategy approach. Learning strategies 
as defined by Alley 5r Deshler (1379), are "techniques, principles, or rules that 
will facilitate the acquisition, manipulation, integration, storage, and 
retrieval of mfonraticn across situations or settings." For exanple, under a 
learning strategies approach, the instructional goal is to teach students 
techniques for organizing materials that has to be memorized for history tests 
rather than teaching them actual history content. Thus, while learning to use 
organizational strategies to inprove comprehension .and retention of history 
concepts, students also learn a skill that theoretically will facilitate 
acquisition of information in other subject areas. An ultimate goal of learning 
strategy instruction is to enable LD individuals successfully to analyze and 
solve novel problems that they encounter in both academic and nonacademic 
environments (Sdiuiraker, et. al., 1983, p. 49). 

In an effort to help the LD adolescent deal with the large volume of 
naterials, tjie research team modified the way in which classroom content was 
delivered to the LD student. Instructional procedures and materials were 
modified with the goal of altering not the content, but rather the forrrat and 
iTcde of presentation of the content. They developed two procedures: 

i. techniques for transferring text book chapters onto audiotapes and 
teaching LD students a corrprehension and organizational strategy 
for leamifig the taped inforrration were developed (Schumaker# 
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Deshler & Dentcxi, 1982). 

2. an advanced organizer technique that can be used by content 
teachers before presenting the classroom lecture was designed 
(Lenz, 1982). 

The modification of raterials involved paraprofessionals taping the nain 
ideas and important facts using a study guide^ chapter textS/ and so forth. 
After the entire chapter had been taped, the students were taught how to survey/ 
obtain detailed information and test themselves. For students whose reading 
levels were more than four years below their grade levels, an alternate version 
of the Multipass strategy {see the attached Compendium for more corrplete 
details) was developed. This strategy', called S.O.S., included the same three 
passes over the textbook chapter as specified £oc Multipass, while 
siniiltaneously using a visually narked version and an audiotaped version of the 
chapter. During the application of the S.O.S. strategy, the student corrpleted 
an or^nized outline. The authors reported that these strategies were designed 
to nake the student active in the learning process (Schurraker, et. al. , 1983). 

Alley and his associates (1983) noted that most LD students were able to 
apply the strategies to raterial at their reading level as well as naterial 
written at their grade level and receive conprehension scores conparable to 
tncse obtained over the easier readings. They reported that the snail nunber of 
students who were unable to generalize to the more difficult naterial exhibited 
a gap of six or more years between reading level and grade level. 

The advanced organizers procedure involved a brief training procedure in 
which content teachers were taught how to use advanced organizers in the 
classes. The coiiponents of an advanced organizer taught to teachers were (1) 
informing the students about the advanced organizer, (2) identifying topics or 
tasks, (3) providing an organizational framework for the class period, (4) 
clarifying actions to be taken, (5) providing background infornation, (6) 
stating the concepts to be learned, (7) classifying the concepts to be learned, 
{3) motivating the students to learn, 19) introducing voacabulary, and (10) 
stating the general outcome desired (Sdiunaker, et. al., 1983, p. 58). 

At first glance, these procedures nay ap^jear to help the learning disabled 
student become more active in the learning process. However, the effect of 
jnodifying the text content and the retraining of teacher's mode of presentation 
resulted in the placement of responsibility for learning upon the teacher rather 
than the student. The researchers stated that the goa3 of this procedure was to 
involve the learner as a more active parcicipant in the learning process but, in 
reality, the modification of text materials could actually enhance the belief of 
nanry LZ students that somc2thing must be changed in the setting in order for them 
to learn. The result is the students have no vested interest in the learning 
process. Reid and Hresko (1381) have eicpressed similar concerns, noting that 
wten it is the LD teacher who assumes responsibility for designing strategies 
taught tc students, the students have miased the opportunity to analyze setting 
demands or to design their own task specific strategy. 

Inese concerns seem to be address^ in the studies conducted at the Center 
for Reading at the University of Illinois. According to Brown and her 
associates (Brown, 1980: Baker & Brown, 1984; Palincsar & Brcwn, 1983), a more 
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extensive, ecologically valid research design capitalizes on the social 
interaction between teacher and student as well as teaches 

coiprehension-^nonitoring strategies. Brown & Campione (1379) have been critical 
of studies which have not incorporated the social interactive nature of learning 
and have not provid<;d for the gradual internalization of executive control by 
the learner. They feel that: 

... the student who is typically told to check, rronitor or self test by 
an experiinenter who invents the program for him has no chance to take 
part in a dynamic social interaction where experts (adults or peers) 
display executive functions in the norml course of problem solving 
(p. 526). 

VJhile there are many similarities between the intervention program at 
the University of Kansas Institute and the studies designed by Brown and 
her colleagues, a major difference was the nature of the teacher-student 
interaction. Two instructional studies directed at 
"coirprehension-fostering" and "corrprehension-nonitoring" activities of 
3unxor high students were reported by Palincsar & Brcwn (in press). ^ The 
investigators used the activities of summarizing, questioning, clarifying, 
and predicting enfcedded within a training procedure that was very similar 
to prototypical interactive mother-child, teacher-student dyads, which 
incorporate Vygotsky's views on learning through interaction with 
significant others. Termed reciprocal teaching, the procedure consisted of 
students and teacher taking turns leading a dialogue concerning each 
segment of text. 

The general procedure was that the adult teacher assigned a segment of 
the passage to be read and either indicated that it was her or his turn to 
be the teacher or assigned one of the students to teach that segment. The 
adult teacher and the students then read the assigned segment silently. 
After reading the text, the teacher (student or adult) for that segment 
sumnarized the content, discussed and clarified any difficulties, asked a 
question about future content. All of these activities were enfoedded in a 
dialogue as natural as possible, with the teacher and other students giving 
feedback to each other. 

During the strategy training the dialogue leader did the following: 

1, paraphrased the rrain idea; 

2, discussed how pieces of inforiration in the paragraph might be 
grouped or classified; 

3, predicted the possible questicns that might be asked about 
the segment; 

4, hypothesized about the content of the reiraining passage 
segments; and 

5, commented on any confusions and how they night resolved. 
After the dialogue, the dialogue leader asked tho other f^rticipant a 
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question concerning that segment. Then the roles were reversed. 

The researchers reported that/ initially/ the students had great 
difficulty in assuming the role of dialogue leader. The adult teacher was 
demonstrating effective conprehension monitoring strategies, but the 
students were relatively passive observers. During the intermediate stage, 
the students became much more capable of playing their role as dialogue 
leader and by the end of 20 sessions, were providing paraphrases and 
questions of some sophistication (Palincsar and Brcwn, in press). 

Upon close inspection of the dialogues/ these researchers noted 
repeated exanples of the teachers providing nodeling, feedback, and 
practice to students at exactly the level they needed. As students became 
better able to perform segments of the task/ the teacher increased her or 
his derands accordingly, until the students' behavior became increasingly 
like that of the adult model/ who in turn decreased her or his level of 
participation and acted as a supportive audience. 

During the course of the study, the students took conprehension tests 
that were given as part of their regular science and social studies 
instruction. The trained stu(tents began the study with scores below the 
20th percentile rank conpared with their age peers, but after the study 90 
percent of the students showed a clear pattern of improvement, averaging a 
36th percentile-rank increase, thus bringing them up to at least the 
average level for their age mates (cited in Baker & Brcwn, 1984). The 
researchers reported that the effect was durable; neintenance probes shewed 
no drop in the level of perfornance for up to an eight week period 
(Palincsar & Brcwn, in press). 

While these studies demonstrate a clear pattern of ecological validity 
which is more prominant in research design than was the case in earlier 
studies cn metacognition, it is clear that both research groups felt it was 
imperative to teach and demonstrate a set of procedures for students to 
learn. Short (1985) notes that in the study conducted by Deshler and his 
assocates (1981) students were expected to take and apply a rule given to 
their, by the researchers rather than to generate their own hypothesis. (See 
Short's article in this book for a more detailed discussion of higher 
levels of cognitive processing.) In the case of Brown's research, it 
appears that students were able to generate their cwi hypotheses regarding 
the main ideas of the passage. However, the authors do not specifically 
address a situation in which a student might generate an hypothesis which 
nay be inconsisent with the content of the passage. 

In the following section/ I will discuss various instructional 
procedures which have been reported in reading corprehension and special 
education literature as well as those reported in research investigations. 
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Strategy Lessons 



As the repertoire of instructional techniques increases/ it is evic3ent that 
research investigators and educators have nade significant progress in 
teaching learning disabled students" meta cognitive skills. Researchers have 
moved from examining cognitive processing stra,tegies using problem boards 
(McKinney & Haskins, 1980), block balancing tasks (Reid I Knight-Are^t. 
1981), and attribute logic blocks (Lester, 1980) in experimental settings 
to instructional tasks in academic settings. 

There seem to be two approaches when research teams design or plan 
instruction. In one approach, the emphasis tends to be on getting the 
meaning from the text, or reconstructing the author's message. The reader 
is thought to be like a sponge, whose purpose is to absorb all the 
important facts from the printed page. Strategies developed from this 
paradigm I have called "teacher-generated" or conprehension-monitoring 
, strategies. 

Given the hypothesis that learning disabled students tend to be less 
active in the learning process and often fail to adbipt a planned and 
organized approach to learning tasks, it is easy to understand why 
researchers have concentrated on procedures that teach 

conprehension-monitoring procedures. However, I would like to suggest that 
there are more aspects involved in the learning pr:ocess than metacognitive 
strategies. How the learner views himself, the teacher, as well as the 
academic setting has important inplications for the success or failure in 
school and cannot be ignored when planning instruction. 

An alternative to the above approach is to focus the eirphasis for 
instruction upon the background and needs of the learner. The reader is 
encouraged to "bridge the gap" between what is known and what has to be 
learned by generating hypotheses concerning the infornation in the text. 
The learner becomes an active participant in the process by predicting, 
confirming and .ntegrating information. Strategies developed from this 
paradigm I have called "schema-building" strategies. 

To illustrate the differences in instructional focus of these two 
paradigms, I have listed several strategies in the following Figure 2 under 
the headings of Ccnprehensicn-Monitoring Strategies and Schema-Building 
Strategies! A complete description of these strategies can be found either 
in the discussion which follows or in the section entitled A Compemdium of 
Strategy Lessons to Try in Your Classroom. 
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Figure 2 
Instructional Strategies 



Ccnprehension-Mcni toring 



S chena-Bu i Idi ng 



Self-questioning 



Text "Encounters of the 
Predicting Mind 



Statement-Pie 



E^R^R^Q 



Multipass (Survey Pass) 



ARMS 



(Size-Up Pass) 



Sdiena Mapping 



(Sort-Out Pass) 



Make Your Own Adventure 



Structural Overview 



Debate 



Reciprocal Teaching 



Using Context to Develop Meaning 



Strategies under the "conprehension-monitoring" heading include the 
corrponehts of skill training/ self -regulation training and awareness 
training in various degrees. I view these procedures as teacher-generated 
instruction. For exanple, when using a Structured Overview (Vacca/ 1981) 
the teacher determines the concepts to be learned and provides a graphic 
organizer for thie topic. All these strategies have been designed to help 
the student learn how to learn by using strategies for reading and 
remembering; using knowledge of the inherent structure of text (its 
syntactic/ semantic and structjral conplexity); knowing the extent to which 
the text's infc^national conten^. is conpatible with existing knowledge; and 
understanding the purpose of the task. 

On the other hand/ "schema-building" strategies are 
"student-centered/ " with the learner highlighting his/her prior knowledge 
and generating the key concepts of the texts. The student determines the 
i.Tiportant points and organizes the relationships between these key concepts 
points. These behaviors are highlighted in a strategy called Schema 
Mapping. The student selects the main points from the text rather than the 
teacher. After the relationships are categorized/ a map is drawn 
illustrating these relationships. As the students shares his/her naps with 
other members of the groups/ not only is it obvious that more than one 
concept can be highlighted/ but an appreciation for other viewpoints can be 
developed. This strategy allows the student to move beyond the text and/ 
at the same time/ encourage flexibility in perspective. 

Besides having proven to be successful/ these strategies are 
open-ended; that is, the strategies provide for differences in studants and 
can be adapted for most age groups. Some of the strategies have been 
developed to help an individual student with a specific need/ others have 
been developed to help groups of students use reading and writing as tools 
for learning content area concepts. The strategies are not presented in an 
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hierarchial nenner, but rather as a collection of suggested methods 
considered to be effective in teaching students. 

The strategies under Scheira-Building have been adapted by teachers and 
graduate students from several universities working with Carolyn Burke, 
Yetta Goodman, Jerry Harste, and Dorothy Watson, so it is difficult to cite 
the original source of the strategy. Versions of these strategies, 
however/ can be found in Goodran and Burke (1980), Busch (1983), and Watson 
(1985). 

I hope I have provided you with a new lens with which to view 
instruction. Certainly research in reading comprehension has changed 
direction and is focusing more on cognitive processing behaviors; than in 
the past. In closing, I would like to encourage teachers to move beycnd 
the teacher-generated method of intervention and provide opportunties in 
their classroom to allow the students to become decision-makers. Both 
situations are applicable in the learning environment. In some situations, 
it is appropriate and necessary for the teacher to be the decision-maker. 
However, it is equally important for the student to have experiences as the 
deciriion-ioaker. How else can the student gain the confidence to take 
responsibility for his/her learning? 
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Self-Questioning Strategy (see Wong & Jones, 1982) 
Rationale: 

Asking questions help reac5ers discover new meanings and adds to general 
knowlec3ge. 

Evaluation: (Who are you teaching?) 

Students who are having difficulty focusing on the text, those who have 
difficulty understanding the text, and those who are not good questioners 
will benefit atom this strategy. 

P rocedure: 

1. The teacher explains that the purpose of this strategy is to help 
students understand what they read. Students ask themselves, 'Why am I 
studying this passage?" (So I can answer some questions.) 

2. Locate the main idea in the paragraph and underline it. 

3. Think of a question abo.ut the main idea. 

4. Learn the answer to the question. 

^. Look back at the question and answer for each paragraph to see hew each 
successive question and answer provides more information about the 
passage* 

Variation/Extensions: 

The strategy could be a basis for a 10 minute uninterrupted writing. Begin 
by asking students: "What predictions did you nake? Was it simi.^^r or 
different from the authors?" 
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Staterent-PIE (see Hanau, 1974: Snolert & Lichter^ 1982) 



Rationale : 

The process of reading and writing requires the application of 
organizational strategies. To understand or express ideas/ writers and 
readers nust formulate a primary topic/ then link this topic to the 
surrounding chunks of infornation (Meyer/ Brandt & Bluth/ 1980) • In this 
way/ readers and writers seek to establish a single topic, then elaborate 
upon it with related propositions/ proofs, exairples/ and counterexamples 
(Hanau/ 1979). 

Evaluation: (Who are you teaching?) 

Students who are having difficulty with organizational skills/ those who 
have difficulty with the processes of learning involving abstraction/ 
analysis and synthesis. This strategy is also helpful to students who have 
difficulty in differentiating najor ideas from less essential PIEces of 
information. 

ProceAjre: 

1. Teachers should inform students that "everything/ whether written or 
spoken/ can be broken into two elements: (a) the statement/ and (b) 
the PIE" (Hanau / 1974, p. 27). The statenent is the nain idea or topic 
of the passage; it is what the passage is about. The PIS are "all the 
pieces of the PIE" that lead us to believe the statement. The PIE is 
an acronym for the author's Proof/ Information/ and Exarrples. To 
denonstrate tc the students the relationship of supporting details to 
their main ideas/ several real-world exarrples should be presented. In 
each case, teachers sould carefully explain the relationship of PIEs tc 
their related statements (i.e./ PIEs are the proof/ information/ 
exaiTples). 

2. Once several real-world exanples have been presented/ students should 
be encouraged to nake up their own examples of statement-PIE/ given a 
statement and an incomplete model of the infcrnntion structure. For 

exarrple/ given the statement/ "I like / " students should 

supply the related details or PIEs to coirplete the infornation 
structure. 

Stateimnt: I like 



3. Present examples from text material. Using several paragraphs/ 
teachers and students should complete a statement-PIE information 
structure. To aid stucfents in Uie differentiation of statements/ 
teach2rs nay cue or pronpt students with such questions aS/ ^v^hat is 
this paragraph about?" or "Tell me in one to three words what the topic 
of the paragraph is." To direct attentivvi related details/ teacJiers 



PIE: 
PIS: 
PIE: 



They 
They 
They 
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nay ask/ "What nakes you believe the author?" or 'What proof/ 
infornation/ or exanples c3oes the the author present that would lead 
you to believe this statement?" 

4. Once the students are able to identify the statement-PIE eleinents in 
paragraphs/ increase the coqplexity of exanples whidi shew 
stateinent-PIE elements in more varied positions* 

Variations/Extensions: 

1. Children should have the opportunity to experience and respond to text 
which has been organized in different ways. Five text structures have 
been described by Meyer/ Brandt and Bluth (1930) • These textual 
patterns involve: problem/solution; antecedent/consequence: 
description conparision: collection. By selecting text exanples that 
typify these patterns/ teachers can help students accomodate 
statement-PIE proce&ires to the varied organizational styles they will 
encounter in written naterial. 

2. Use statement-PIE to develop writing ability. Give students a picture 
and ask them to generate two or three tcpic statements about the 
picture. These statement need not be expressed in complete sentences/ 
txit niust represent the overall irrpression of the scene. After writing 
statements/ students should write three related PIEs for each 
statement. PIEs can be written as phrases, sentences/ or sentence 
fragments. These statement-PIEs can serve as an organizational map 
from whidi the students can write a ccJiesive passage. 
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Multipass (see Deshler, 19S1: Schunaker> Deshler, Allev> winner, 1^53: Robinson> 
1945) 

The Multipass strategy incluc3es three substrategies: Survey, Size-up, and 
Sort-Out. Each substrategy requires the reacSer to "pass" through the text. In 
teaching the substrategies it is nost efficient to teach each substrategy 
separately and then corrtoine them. 

Survey Pass 



Rationale : 

The purpose of the Survey Pass is to becone familiar with the nain idea and 
organization of the text/ for instance/ a chapter in a content area 
textbook. 

Evaluation: (VJho are you teaching?) 

Students who are having difficulty in reading assignments in their content 
area will benefit from this strategy. 

Procedure: 

1. Read the chapter title. 

2. Read the introductory paragraph. 

3. Review the chapter's relationship to other adjacent chapters by 
perusing the table of contents. 

4. Look at the illustrations and read their captions. 

5. Read the surmBry paragraph- 

6. Paraphrase all the inforiraticn gained in the process. 
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Size-Up Pass 



Rationale: 

The second substrategy is desigijed tc aid the student in gaining specific 
infornaticn and facts presented in the text. To direct the student's 
reading, the questions at the end of the chapter are read first/ and 
questions the student can already answer are checked. The student then 
proceeds through the chapter utilizing the following steps: 

Procedure : 

1. Read the headings and subheadings and cue wordc# e.g. italics, 
bold-face print. 

2. Change the infonration in the heading or cue into a question. 

3. Skim the surrounding text to find the answer. 

4. Paraphrase the answer. 

At the end of the chapter the student paraphrases all the facts and ideas 
that can be remembered. 



Sort-Out Pass 



Rationale : 

The third pass engages the student in testing himself on the infornaticn 
presented in the chapter. 

Procedure : 

The student rereads the questions at the end of the chapter and attenpts to 
answer them from memory. If the student answers the question correctly, a 
checknark is placed by the question. If the stucfent is unable to answer a 
question, the answer is obtained by thinking where the answer is located in 
the chapter and skimming that section. 

Variations/Sxtensions : 

Teachers using iMultipass nay want to develop their own questions over the 
text rather than using the questions at the end of the chapter. This 
ensures that the students are focusing on and studying the infornaticn the 
teacher deems critical (Bos, 1983) • 
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ERRQ — Estimate/ Read, Respor-S, Question (see Watson, 1985) 
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Rationale : 

Reac3ers who make a coimiitment to the text and try to link new infornBticn 
to their own background of experience are nore likely tc generate meaning 
from text. Questioning serves as a vehicle to discovery. 

Evaluation : (Who are you teaching?) 

Students who do not personalize their knowledge and students who have 
difficulty asking and answering questions will benefit from this strategy. 

Procedure : 

1. Explain to the students that ERRQ stands for Estinate/ Read/ Re^ond 
and Question. Have students select something they want to read/ look 
it over and ESTIMATE how far th^ can read with understanding. Hew far 
can they "stay with" the text? Have them mark that place lightly in 
pencil or record the page nunber. 

2. Students READ the text. They nay read silently/ orally, with paired or 
assisted reading. As they are reading/ ask them to think about hw tiie 
text nakes them feel/ if any images or words come to mind. Does the 
text remind them of anything from their own lives? 

3. After reading/ have the students first REACT to the reading. What came 
to mind as they read the article? Did images or memories flash in 
their minds? How did it make them feel to read the article? After 
they have reacted/ have them retell everything they can remeirfcer about 
the article. 

4. Have students ask at least two questions about their reading. These 
questions can be "school-type" (such as 'l-Jhat was the main idea?") or 
personal questions (How will the book end/" "Why was it so sad?"). 

Variations/Extensions : 

1. The form can be modified. Students can do the RESPONSE and QUESTION 
sections orally or in writing/ depending on the size of the group/ the 
age/ and the purpose. 

2. The student can select materials/ or in a content class the teacher can 
select the irate rials. 

3. The REACTION portion of the RESPONSE can lead naturally into the 
RETELLING. Many students begin reacting and end up retelling. 
Usually/ the better the reaction/ the better the retelling will be. 
Depending on the quality of the reaction and the teacher's purpos<^/ the 
retelling need not be done every time. 

4. The QUESTIONING portion can be modified. If students have great 
dxfficuty asking apprc^riate questions as they read/ the teacher could 
demonstrate the procedure by sharing questions with them. 
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Structured Overview (see Vacca# 1983) 



Rationale: 

When students are asked to read and learn from lengthy texts (whole 
chapters/ units of similar length)/ their learning will be enhanced if, 
before they read/ they have in mind the structure and the major points of 
infornation in the text. 



Evaluation: (Who are you teaching?) 

otudents who are having difficulty with reading assignments in content area 
classes will benefit from this strategy. 



ProceAire: 



1. Select words and concepts from the reading selection which are 
important for student's increased understanding. 

2. Organize these words and concepts in a diagram which shews the 
relationship arrong these ideas (see following page for an example). 

3. Before reading the chapter or unit/ draw the diagram on the chalkboard. 
Discuss the arrangement of the concepts and their relationships. 

4. Enoourage students to refer to the structured overview when it is 
appropriate throughout the reading of the chapter. 



Variations/Extensions: 

1. Present a partially conpleted structure and ask students to corrplete it 
as they read the chapter. 

2. Use the hms strategy for pupil initiated key concepts. 
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WCOMPLETE STRUCTURED OVERVIEW 

3 KINGDOMS 
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ARMS (Anticipate/ Read/ Map/ Suirmarize) Strategy (see Susch/ 1983) 



Rationale: 

To denonstrate to students that what is already known can be used to 
predict what will be encountered in a text. Based on previous experiences/ 
one develops a scheira/ a set of expectations about different texts. 

Evaluation: (Who are you teaching?) 

This strategy will benefit the student who has difficulty in relating prior 
knowledge to inforiration presented in the text as well as provide a schena 
for the material to be read. 

Procedure: 

1. Put title on chalkboard from a pre-selected short article. 

2. Have students list 5-7 items they knew about the title or predict will 
be in the article. 

3. Students share ideas they listed. Participants rrey add or delete any 
items from their lists- 

4. Choose 5-6 items and organize into a diagram. 

5- Skim article/ note subheading/ illustrations and diagrams. 

C. Annotate articlei underlining nain ideas and paraphrasing infornation 
in the nargins of the text. 

7. Put key concepts from article on 3x5 cardS/ one concept per card. 

3. Arrange cards into a schena nap shewing relationships among ideas. 

9. Draw nap on paper. 

10. Use nap to write a sumrary of the article. 

11. Have students conpare their new map with their map of their prior 
knowledge about the topic and indicate the areas in which there are 
differences. This procedure denonstrates to the stjdent areas in which 
leaminq has been enhanced. 
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Text Encounters of the Predicting Mind (see Busch^ 1983) 
Rationale : 

To demonstrate that what is already known can be used to predict what will 
be encountered in a text. Based on previous experiences, one develops a 
schema/ a set of expectations about different texts* Use of these schema 
enables the reader to understand and organize information. 

Evaluation : (Who are you teaching?) 

This strategy will benefit the student who possesses the appropriate schema 
but fails to bring it into focus for purposes of oonprehending a particular 
passage. 

Procedure : 

1. Put title of history text on chalkboard. 

2. Have students nake a list of things they predict will be found in the 
chapter. This can include comments regarding graphics expected to be 
included in the text. 

3. Skim through the chapter looking at headings, subheadings, graphics/ 



etc. 



Return to first subheading and predict 2 or 3 items. 



Read subsection and assess hew close predictions were. 



Repeat predictions and evaluations throughout chapter. 
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Make Your Own Adventure (see Busch/ 1983) 
Ra tionale : 

Stuc3ents learn story structures by listening to various literature. One 
way of continuing to develop a "sense of story" for various materials is to 
reconstruct and conpare schenata. 

Rvaluation : (Who are you teaching?) 

Students who need to further develop a "sense of story" or who have 
difficulty in predicting should benefit from this strategy. 



Procedure : 

— 

1. Select a narrative that has an easily identifiable beginning/ plot 
developnent and ending. The story can be from a content area (social 
studies or science) or other narrative. Cut the story into 3-6 
sections/ depending on the reader's abilities. Each sectioi must be 
long enough to give the readers something substantial to read — even 
though they might be reading something from the middle of the 
selection. 



2. Ask each student in the group to read the selection silently/ thinking 
what must have happened before and after that particular excerpt. 

3. After reading silently/ ask who might have the beginning of the story. 
Student reads it aloud. The other students listen to see if they agree 
that the beginning has been chosen and to see if they have the next 
section. Proceed through the story in a similar manner/ making and 
testing predictions/ discussing the sections and listening to each 
other. 



Variations/Extensions; 



1. In social studies or science, this strategy could serve as a useful 
review of the chapter/ if the surrmary statement was used. It could be 
used with several groups simultaneously to involve nore people. 



Students could write their cwn selection that have a distinct 
beginning/ middle and end/ to be used by the whole group for Schema 
Story iTQterial. 

Students m the group could put secti'Xis 1-5 in order in the group/ and 
then each person write the ending. Then all the endings would be read 
and discussed. 



/ 
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Resources: 

1. Old textbooks that are no longer being used can be cut up. 

2. Scholastic Scope and Sprint magazines. 

3. Recipes/ brochures/ or directions for gaines. 

4. Articles from the newspaper. 
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Using Context to Develop Meaning (see Busch/ 1983) 



Rationale : 

•Reading involves the integrated use of all the cueing systems — the words / 
the graimwr ^£ the sentence and the fneaning of the sentence and passage* 
This lesson helps the reader make better use of the cues from the meaning 
system/ as well as those from the grammar system* 

Evaluation : (Who are you teaching?) 

Students who concentrate only on print and don't "read for meaning" will 
benefit from this lesson. Also/ students would benefit who make some use 
of context within a sentence but not in the whole text. 

Procedure : 

1. Tell the students that they will be reading a text in which there may 
be an unknown word. During the reading/ the students will discover the 
meaning of the unknown word. (An exarrple passage is at the end of this 
strategy lesson. ) 

2. Using an overhead projector/ reveal one sentence of the text to the 
students. Students predict the meaning of the word which is unknown or 
produce a synonym. Write all the predictions on the board. Accept all 
predictions and encourage the students to do likewise. Reveal the 
second sentence and cross out all predictions that all the students 
agree are not appropriate. 

3. Add new predictions. Continue in this nanner until all the text is 
read. More than one word may irake sense/ but not usually. 

Variations/Extensions : 

1. This can also be used by smaller groups or even by pairs of students. 
The students could also rrake individual predictions and discuss their 
predictions after the text is totally revealed. 

2. Students can play the game df "Who Am I?" or What Am I?" giving clues 
which progress from the more general to the more specific. "Who Am I?" 
or "What Am I?" could also be written in prose or poetry and then 
exchanged. 

3. Using pictures of the "Who" or "What" on one side of a paper/ the clues 
could be written on the other side. This could be nad^ into a book 
which could be useful in the content areas for building concept 
background. 
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Debate (see Watson/ 1985) 



Rationale : 

This strategy helps students realize that they need tc iiake decisions as 
they read/ such as agreerent or disagreement with the point of view 
presented. 

Evaluation : (Who are you teaching?) 

This strategy will benefit students who need to take a ncre active part in 
the reading process. 

Procedure : 

1. Ask students tc read a selection such as an editorial from a new^>aper 
or nagazine/ presenting a point of view on a particular subject. As 
them to consider as they read whether they agree or disagree with the 
author's opinions. 

2. Ask students to read the selection a second time and underline with 
blue ink all the statements with which they agree. All the statements 
with which they disagree sould be underlined with red ink. 

3. Open discussion after the second reading. Encourage students to talk 
first about statements the author nade with whidi they agree. Next, 
discuss corrments with whidi they disagree. Encourage students to 
explain their opinions and why they agree or disagree with the author. 

4. inroiighout the discussion students should be encouraged to challenge 
each other's statements. Enptesize the use of tact w!ien challenging. 

Variations/Extensions : 

1. Students read several authors' opinions on a oontenporary issue and 
conpare their views. 

2. Students could gather inforration and debate certain issues. 
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A KEW LEKS FOR READING COMPREHEKSIOS: 
COMPREHENSION PROCESSES AS CRITICAL THINKING 

Kathy Gnagey Short 
Indiana University 



INTRODUCTION 



A recent trend xn reading theory and research has been to view reading 
as a process of critically examining and evaluating the ideas of an 
author and constructing personal interpretations of texts. The 
following classroom discussion is an example of children who" respond to 
texts as critical thinkers. 

A small group of first grade children are engaged in a 
literature study of the story, The Three Billy Goa ts Gruff. 
The discussion is an open-ended one in which the children 
freely discuss their personal interpretations of the story and 
the teacher facilitates the discussion with occasional open- 
ended questions. As they discuss the characters in the story^ 
the children begin talking about whether or not the troll had a 
right to be upset when the billy goats went over the bridge. 
Sherri says that he did because the bridge was his home and the 
goats were too loud going over his home. "He needed to relax 
and so he got mad at them." "Yes," says Stephanie. "He wanted 
to sleep and get his rest or maybe he was trying to eat and 
they disturbed him." She goes on to say that maybe the troll 
used to be kind and nice but then he got angry and so now is 
mean. Erin takes the other side of the argument and says that 
the troll should not have gotten upset because "bridges are 
supposed to be shared." 

As the discussion of the characters continues, the 
children debate about which of the billy goats was the bravest. 
Rxchard claims that the biggest billy goat was because "he 
knocked the troll down" but Erin counters by pointing out that 
"the littlest had to go first to face the troll" and so was the 
bravest. Kr^-stine argues back that the first billy goat wasn't 
the bravest because it didn't know about the troll. As the 
conversation continues, Sherri points out that the billy goats 
might have all gdttcn eaten up. The teacher asks why they 
think the author didn't have this happen and instead had all 
the billy goats escape, Richard answers, "ile probably likes 
goats*" Sherri tJikes another point of view and states, ''He 
wanted it neater and not so sad. He didn't want any crying." 
"Vcs," says Sheila- "The person who is reading might stop at 
that page and not read on because it would be too sad if all 
the billy goats die." The group goes on talking about why 
authors use happy endings and their effect on the reader 
(Short, field notes: 1955) 
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The children engaged in this discussion are critical readers who 
examine and evaluate the characters' actions and xnotxvations as well as 
the author's rationale for the happy ending of the story. They freely 
pull ^.n their own personal experiences from their own worlds and from 
other texts they have read in the past in constructing their own 
meanings for this well known folktale. 

In recent years, there has been a growing recognition that 
reading is an active thinking process in which the reader makes 
efficient use of strategics to construct meaning from print. (Goodman, 
1983; Smith, 1978) The emphasis on reading comprehension as a critical 
thinking process has provided a new lens for looking at and 
understanding comprehension processes. This recognition is reflected 
m the recent trends xn research on reading comprehension which were 
discussed m Chapter 5: the acknowledgement of the active role of the 
reader and a focus on higher levels of cognitive processing m reading. 
At the same time, the National Assessment of Educational Progress 
(KAEP) reports that while most students are learning basic reading 
skills, they are not learning how to analyze or evaluate what they 
read. The KaEP points out that the end result is an emphasis on 
"shallow and superficial opinions at the expense of reasoned and 
disciplined thought." (EDUCATION USA, 1981: 89) 

Recent national reports on schools by Boyer (1984), Sizer (1984), 
and Goodlad (1983) have picked up on this concern and have called for 
increased attention in schools to problem-solving, reasoning and 
critical thinking. There appears to be a growing realization that the 
emphasis on "basic" skills has had a negative impact on students' 
abilities to actively interact with, and critically evaluate written 
text. Teachers are being urged to give greater attention in their 
classrooms to critical thinking and reasoning. Based on the various 
reports, V it becomes obvious that the classroom described above where 
children arc active, critical readers and thinkers is not a typical 
classroom. Most classrooms are not places where students are currently 
encouraged to critically examine and evaluate their own ideas and the 
ideas of their peers as well as the authors of both the fiction and 
non-fiction texts that they read. 

This emphasis on reading as a process of critical thinking or 
reasoning is not new. In 1917, Thorndlkc suggested that reading was a 
form of reasoning and that reading comprehension should be viewed as a 
process similar to that described as taking place during problem- 
solving activities. In 1937, the Committee on Reading of the National 
Society for the Study of Education stated, "Any conception of reading 
that fails to include reflection, critical evaluation and clarification 
of meaning is inadequate." (Gray, 1937) More recently, Stauffcr (1975) 
stated that reading is largely a thinking process and Clark (1975) 
suggested that reading was a problem-solving process in which the 
reader uses various strategies to relate the author's message to 
information m memory. Rosenblatt (1978) developed the viewpoint that 
reading is a transactional process where the reader actively constructs 
a text during reading through transactions with the published text. 
Meaning does not simply pass between the writer and the reader but is 
represented by a writer in a text and constructed from the text by the 
reader. 
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Recent research lends support for the notion of reading as a 
problem solving process. Olshavsky (1976) used protocal analysis to 
identify strategies readers use. She believes that the types of 
strategies that were identified lend support for a theoretical position 
that reading is a problem-solving process. Olshavsky suggests that 
readers identify problccss and then apply strategies to solve these 
problems. Ycazell (1982) found that when children are taught to reason 
using techniques of logic and are encouraged to think reflectively and 
critically about the materials they read» that their scores on 
standardized reading tests arc higher. Yeazell states that the skills 
of logical and critical thinking have a definite place in the 
elementary curriculum and are the real "basics." 

To suggest that reading is critical thinking is to suggest that 
effective teachers understand critical thinking and utilize methods 
found effective in improving critical thinking. This chapter will 
consider both of these needs by 1) discussing the three components of 
critical thinking and 2) providing an overview of current reading 
comprehension instructional research to see whether the instructional 
strategies included in this research offer teachers practical 
alternatives on how to develop the critical thinking abilities of their 
students. Our close examination of this research has led us to believe 
that very few instructional procedures in the reseavch enhance critical 
thinking. Based on the current move in the field towards defining 
reading as critical thinking, this becomes an important issue for both 
teachers and researchers to explore. 



™l '^i^? £9?1E2551?T§ 9Jl critical thinking 

In order to examine how classrooms can enhance critical thinking^ 
one must first have a definition of critical thinking. It is usually 
defined as the process of making judgments. (Harris and Hodges^ 1981) 
Gray's (1937) description of it as including reflection^ critical 
evaluation, and clarification of meaning is helpful in trying to 
understand what is meant by critical thinking. Critical reading simply 
means that one is using the critical thinking process but applying it 
to written language as one reads. The person who has probably done the 
most extensive work on critical thinking is Charles Sanders Peirce 
(1839-191^). Peirce was an American philosopher who wrote and thought 
about the topic of logic or critical thinking and developed a 
description of the process of critical thinking. Peiice*s description 
of cntii'al thinking remains general enough to keep it it the level of 
a general cognitive strategy that underlies thinking and specific 
enough to be able to discuss the components of it and evaluate 
instruction to sec whether it really is enhancing critical thinking. 
Because of this, Pcirce's definition of critical thinking will be used 
as the basis of this chapter. 

Pcircc saw critical thinking as the method through which knowledge 
develops and inquiry takes place. He defined critical thinking or 
reasoning as a process in which the reasoncr consciously makes a 
judgment or conclusion regarding the truth of something. Peirce 
maintained that reasoning docs not begin until a conscious judgment has 
been formed. The subconscious cognitive operations prior to this 
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Judgment are not subject to logical analysis and so are not critical 
thinking. (Peirce, 1966) 

Peirce discussed three components of critical thinking which he 
saw as occuring in cyclical stages. The following example may be 
helpful in understanding how the process of critical thinking might 
operate for a reader. 

The reader is reading the following passage which he/she has 
predicted will be about people talking about the animals at the zoo. 



A DAY AT THE ZOO 

The day was bright and sunny~a good day to be at the zoo. 
Many animal sounds and shouts of laughter filled the air. 

"Look at that funny fellow!" said Ambrose. 

"Throw him a peanut, quick, before he turns away!" cried 

Judy. 

"Oh, he caught it and is going to throw it back! Clever 
fellow. Sometimes they seem fairly bright, don't they?" 

"He*s scratching his head. They always scratch their 
heads. Maybe they think it makes them look wise, but they're 
probably looking for fleas." 

"It's feeding time! First one down in a rotten monkey!" 
Ambrose shouted as he swung himself deftly down from the top of 
the cage to the floor. 

"Oh, Ambrose, wait for me," cried Judy. "Visitor's Day at 
the zoo gives me such an appetite." 

by Charlotte Hazelwood (Goodman and Burke, 1980:158) 
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The reader continues with the prediction that the passage is a 
conversation between people about animals at the zoo guiding his/her 
reading until the reader gets to the sentence about feeding time. At 
this point, the reader is confronted with an anomaly because this is 
not a statement he/she would expect to hear a person say about an 
animal. Even if the reader is not bothered by this statement, the next 
several sentences will definitely prod^jce an anomaly for the reader. 
As the reader continues reading these next sentences, he/she searches 
for an explanation that will explain how these sentences fit into a 
story about the zoo. The reader will probably attempt to use what 
he/she knows about stories, about conversatioi.5, the zoo, people, and 
monkeys to try and resolve this conflict with the reader's initial 
expectations for the story. The hypothesis, "Oh, it's monkey talliing 
about people." will suddenly pop into the reader's head as a result of 
this search for an explanation. The reader will then deduce several 
ideas that must be true if this really is monkeys, and not people, 
talking and will either reread or rethink what was earlier read and 
read ahead to test out the hypothesis that is monkeys talking. 
Obviously, this whole cycle of crl4:ical thinking takes place in several 
seconds and it would probably be difficult for a reader to discuss 
exactly what processes of thought took place. However, there is a 
conscious realization that something is wrong, which results in an 
hypothesis and then reading on to confirm that hypothesis. 
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ABDUCTION 

Peirce believed that every instance of critical thinking begins 
with the observation of something that is surprising, something that 
would not have been expected and so serves as an anomaly. This anomaly 
xs not the same as cognitive dissonance as discussed by Piaget because 
an anomaly is a transaction between both environmental and cognitive 
phenomena. (liars te, 1984} This anomaly causes a person to stop and 
think and search to find some point of view or circumstance that will 
explain the unusual occurrence. In the zoo story, the conversation 
produces an anomaly because it conflicts with the reader's 
expectations. The person eventually comes up with an hypothesis that 
supplies a possible explanation or guess for why the surprising fact 
occurred. Peirce suggested that this occurs because the person is 
looking for a resemblance and notices some remarkable character or 
relation among the features of the unusual occurrence and recognizes 
this as characteristic of some conception which is alrer ly stored in 
the person's mind from past experiences. This process suggests a theory 
or hypothesis which could explain the surprising occurence- The 
person also then needs to decide whether or not this hypothesis seems 
plausible enough to go ^hcad and test out. Peirce called this process 
abduction and considered it the first component of critical thinking. 
What the person has done is to reason from an effect to a possible 
cause for that surprising effect and then evaluated the possible truth 
of that hypothesis. (Peirce, 1966) In the example given, abduction 
involves coming up with a possible explanation for the unusual 
conversation between the two *-hara«.ters and then deciding to go ahead 
and test out the hypothesis that this could be animals rather than 
people talking. 

DEDUCTIOK 

Abduction is hypothesizing a possible explanation for the 
surprising occurrence but this hypothesis must now be tested to see 
whether xt really could be an explanation for what occurred. This 
testing does not begin by examining the surprising fact but by 
examining the hypothesis that the characters are monkeys to see what 
kir.d of predictions could be made about what should occur if one 
accepts the hypothesis. The person thinks through all the possible 
implications and consequences which would follow from holding that this 
idea or hypothesis is true. This process Peirce called d eduction and 
consists of reasoning from the general idea to specific ideas that 
would necessarily follow from holding the general idea. Peirce pointed 
out that the person may actually form a diagram in their minds to 
reason through all the possible consequences of the hypothesis. 
(Pcircc, 1966) 



Once these possible consequences have been expXicated» the third 
component of critical thinking takes place. In this component of 
critical thinking, the person is concerned with taking these 
consequences and testing them out against experience to see whether the 
hypothesis makes sense or requires some modification or if it needs to 
be totally rejected^ If the hypothesis is rejected or needs to be 



induction; 
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roodxfied, the entire cycle begins again. This testing out of the 
hypothesis against experience is called Induction. In the example, 
induction consists of testing out the hypothesis that this conversation 
IS between monkeys as the reader continues reading the rest of the 
passage. Induction does not originate a new idea but begins with a 
theory suggested by abduction and tests out how well predictions based 
on that theory correspond with experience. The essential role of 
induction is that the process of testing out allows us as thinkers to 
eventually correct our reasoning. (Peirce, 1966) 



FIGURE 1: THE COMPONENTS OF 'HIE CRITICAL THINKING CYCLE 



ANOMALY 




(Tests ideas) 



Pcircc believed that these three are the only three components of 
critical thinking. However, he also pointed out that critical thinking 
does not tend to be purely one component but rather that the three 
occur together and arc not separable. (Peirce, 1966) Therefore, 
attempting to look at one component of critical thinking totally 
separate from the cycle in which they operate interdependently will 
cause misconceptions about that component of critical thinking. 

While induction and deduction arc commonly discussed by many other 
philosophers, abduction is often omitted as a form of critical 
thinking. Pcircc pointed out the necessity of abduction to the process 
of inquiry in that it is the only component of critical thinking which 
can contribute a new concept. If we did not have this component of 
critical thinking available to us, we would not be able to add new 
ideas and make new connections between old ideas but would simply be 
able to explicate and evaluate the ideas we already have. Without 
abduction, the reader of the 7.00 passage would continue to read and 
evaluate the passage based on the earlier hypothesis that this passage 
was about people conversing at the 7.00 about the monkeys. Deduction 
simply states what would ideally and necessarily follow if we hold a 
certain theory or hypothesis while induction sets out with a theory and 
i;.oasures how well it agrees with experiences or facts. Therefore, 
neither can originate a new idea. (Peirce, 1966) 

Pcircc attempted to clarify the distinctions between the three 
components of critical thinking by pointing out that deduction proves 
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that something must be; induction shows that something actually is 
operating; and abduction suggests that something may be. From the 
suggestion, that comes from abduction, deduction can draw a prediction 
that can be tested by induction but, if we are ever to learn anything 
new or to understand phenomena at all> it must be by abduction that 
this is brought about. The new adeas generated by abduction are ideas 
that are new for the individual person. The reader has put together 
two ideas that previously were not connected and so generates or 
creates a new idea or hypothesis of explanation. Abduction seeks 
theory or understanding while induction seeks facts. (Peirce, 1966) 

Critical thinking is a move from the known to the unknown. 
Abduction, deduction and induction provide different paths of criiical 
thinking. Abduction 'generates ideas, deduction develops them, and 
induction tests the ideas out. To be effective, instructional 
strategies in reading comprehension need to enhance students' use of 
all three components of critical thinking so that they become creative 
and critical evaluative readers. 

The next section of this chapter will 1) review instructional 
research in reading comprehension in light of Peirce' s three components 
of critical thinking to see if the instructional strategies researched 
attempt to develop critical thinking abilities and, if they do, 2) to 
determine the component(s) of critical thinking they focused on, 
keeping in mind, Peirce 's notions of being cyclical and the three 
components as being inter-related. 

^r^PIb'? 59i??55i??5^§I9b' 5??§T5y?n9]fAL research 

The research that will be reported here is based on a data base of 
the approximately 175 instructional studies out of more than 570 
reading comprehension studies published between 197A and 198A. This 
data base was established as part of the USDE funded research project. 
A study IS considered instructional if the intention of the study was 
to teach students using a technique that would in some way affect 
reading comprehension. 

All instructional treatments were coded into one of ten levels of 
cognitive processing. The first levels of processing strategies 
involved strategics aimed at factual recall, identifying word meanings 
and identifying text structure. These categories were seen primarily 
as reflecting the point of view that reading is information transfer 
from the text to the reader. The second level of categories considered 
reading as a cognitive process which involves interaction between the 
reader and the text. These categories went beyond ideas stated directly 
m texts tind included drawing inferences, schema construction, schema 
maintenance, sch^na selection^ prediction, and chunking or summarizing 
written information. The third set of processing strategies were based 
on a transactional notion of cognitive processing where both the reader 
and the text are seen as being changed in the process of reading and a 
new meaning is constructed th;it goes beyond either the text or the 
reader. This set of categories involved using transmedlation and 
analogies or metaphors to increase comprehension. The category of 
transmedlation included studies in which there was a move between the 



ERIC 



144 



LANDSCAPES: CRITIC.V- THINKING 



7:8 



written communication system and some other type of communication 
system such as imaging or drama. As most of the research coded fell 
into six of these ten categories - identifying word meanings, 
identifying text structure, inferencxng, macro-operators isummar izing) , 
transmediation, and metaphor/analogy - only strategies from 
instructional studies in these six categories will be examined below. 



FIGURE 2: COGNITIVE PROCESSING CATEGORIES 



LEVEL I - INFORMATION TRANSFER 
Factual recall 

* Identifying word meanings 

* Identifying text structures 



LEVEL II - INTERACTION 

* Inference 

Schema construction 
Schema selection 
Prediction 

* Macro-operators (summarizing) 

LEVEL III - TRANSACTION 

* Transmediation 

* Analogies and metaphors 

An examination of instructional studies in these six categories 
revealed a number of concerns about whether the instructional 
strategies xn research are effective in enhancing critical thinking. 
Many of the instructional strategies involved having students apply a 
rule which has been generated and given to the student by the teacher. 
Some instructional strategies had the student repeat something from 
memory. While critical thinking, applying a rule and memorization are 
all thinking processes, they represent different kinds of thinking as 
the following diagram tries to illustrate. 

FIGURE 3: THINKING 



THINKING 




EXAMINED IDEAS 



UNEXAMINED IDEAS 
(Practical Knowledge) 



CRITICAL THINKING RULE APPLICATION 

(Abduction, deduction, induction) 



MEMORI^CATION 



Self 
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Others 



Othrrs 
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In rule application and memorization » the teacher is the active 
critical thinker while the students are expected to simply take the 
rule as a given and apply it. They are not involved In testing the 
rule cut. In critical thinking, the student generates, explicates and 
evaluates a rule or hypothesis. The student is actively examining 
ide<^s like the first grade students described at the beginning of this 
chapter. When a student is to take an apply a given rule, he or she 
does not examine ideas and so this does not facxlitate critical 
thinking and reading. 

In addition, it is apparent in these studies that although Peirce 
maintains that each of the three components of critical thinking are 
interdependent, instructional strategies which do involve critical 
thinking often have the teacher involved in abduction and the students 
in deduction and/or induction. 

Another concern that emerged from an examination of the 
instructional strategies in research is that the dependent measures 
used by researchers were not open-ended enough to measure the critical 
thinking that students engaged in during the instructional procedure. 
Critical thinking xs a generative process where students develop and 
test out their own hypotheses about what they are reading. Because 
these hypotheses are based on personal experiences as these transact 
with the text and everyone has different personal experiences, it seems 
improbable that all readers would have the same hypotheses and 
interpretations of a text. However, researchers continue to evaluate 
the effectiveness of a strategy by measuring the students' 
comprehension against their own "correct" model of what the student 
should have come up with. This issue is discussecf further in Chapter 
11 of this book. 

The next section of this chapter will look at specific studies in 
each of the six major categories of cognitive processing in order to 1) 
examine the concerns noted above about the effectiveness of 
instructional strategies in enhancing critical thinking and to 2) see 
which instructional strategies offer the most potential m encouraging 
critical thinking. 



Several studies attempted to teach students word meanings and then 
measured the effect of this instruction on comprehension. Pany, 
Jenkins and Suhreck (1982) compared three instructional treatments for 
vocabulary knowledge. In the first. Meanings from Context, students 
read two sentences in which the first contained the target word and the 
second contained a synonym for that word. In the second treatment. 
Meanings Given, students read a sentence containing the word and then 
the experimenter gave the student a synonym for the word and a sample 
sentence containing the word. In the third treatment. Meanings 
Practiced, the student read the single word, was told the synonym and 
sample sentence by the experimenter, and then repeated the word and 
synonym. 
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In the first procedure, the reader is given the chance to abduce a 
meaning for the unknown word but because there are only two sentences 
there is no support for developing or testing this hypothesis out. The 
reader does not really have to critically think about the meaning of 
the word because there are only two sentences and no real need 
therefore to grapple with the word. In the other two procedures, the 
reader does not have to think critically at all because the researcher 
tells the reader exactly what he/she needs to know and all the reader 
has to do is to repeat back exactly what the researcher has said. 
There is no active involvement of the reader's critical thinking 
processes. This is reflected in the findings that while the readers in 
the Meanings Practiced treatment scored better on isolated vocabulary 
tests, there were no differences between the three groups on measures 
of passage comprehension. 

Vaughan, Castle, Gilbert, and Love (1982) compared the definition 
approach with an experience based approach. In the definition 
approach, the teacher told students the definitions of the words and 
the students repeated back what the teacher said. In this approach, 
the students are not engaged in any of the three components of critical 
thinking as defined by Peirce. 

In the experience based approach, the teacher had the students 
discuss terms similar to the key word and then giradually moved students 
towards the key word. In this condition, the teacher is the one that 
does the initial critical thinking; the students simply have to 
inductively test out the teacher's hypothesis. The teacher decided 
that the word would be an anomaly, deduced the crucial components of 
the word's meaning and then presented these to the students. While the 
experience based approach does involve students more actively in 
critical thinking than the definition approach, the teacher is the only 
person who appears to benefit from active thinking through abduction. 

Bridge, Winograd, and Haley (1983) took a different instructional 
approach to learning vocabulary words. They involved students in 
reading predictable materials (patterned language bookfi and dictated 
language experience stories) while the control group read in the 
regular basal prept imer and followed the instructional suggestions in 
the teacher's manual. The predictable materials group read the 
patterned book or experience chart using shared reading and choral 
reading and then matched sentence and word strips to the lines from the 
story. The students using the predictable materials learned more 
target and non-target words than children from the preprimer group. 

Both the type of reading materials and the instructional 
procedures used by the predictable materials group supported the 
critical reading of the students. They dealt with words within the 
context of a whole story and were not required to produce the teacher's 
definitions for the words. Instead they could generate hypotheses 
about the words, make predictions based on these hypotheses and then 
test them out becauae of the repeated readings and the rich context of 
a unified text. The children using the predictable materials appeared 
to be making better use of context clues and so were using syntactic 
and semantic cues rather than only graphophonic information. 
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IDENTIFYING TEXT STRUCTURES 

This category of instructional research primarily identified 
studies which taught children strategies aimed at identifying different 
levels of text structures. Weaver (1979) investigated how to improve 
reading comprehension through working with sentence structure. She 
taught students a sentence anagram task and word-grouping strategy 
aimed at getting them to "chunk" words into higher order units by 
teaching them how to arrange words systematically into phrases and then 
to arrange the phrases into sentences. The thinking processes involved 
in this strategy appear to involve applying a rule given to the 
students by the researcher. Critical thinking strategies are not 
involved because not only are the children not involved in generating 
the rule, but they are also not involved in testing out the rule. The 
rule is a given and they are to apply it to experience* not test it out 
against experience. 

Sampson* Valmont, and Van Allen (1982) focused on syntactic 
structure in an instructional strategy using cloze materials in which 
words were selectively deleted in order to emphasize a particular 
syntactical relationship such as adverbs. After completing the cloze 
passages » students met with the teacher to discuss the variety of 
possible answers which would make sense semantically and syntactically 
in the passages. 

It would appear that the blanks in the cloze passage could cause 
an anomaly for the reader. The reader would need to make an abduction 
or hypothesis about what the word is, make some deductions about what 
should come next based on that hypothesis, and then test that 
hypothesis out as t'he reader continues reading the passage. Because 
the instructional procedure involved accepting any answer that made 
sense syntactically and semantically and did not require the reader to 
match an answer exactly with the researcher's answer, the strategy 
allowed the flexibility readers needed in using their own background 
knowledge to generate hypotheses. However, the dependent measures were 
more restrictive in their view of language and so did not fully measure 
the generativeness of the critical thinking strategies involved in the 
instructional procedures. 

Cohen and Stover (1981) developed an instructional procedure to 
help students deal with the structural format variables of math word 
problems. They identified three format variables by analyzing the word 
problems that gifted students had rewritten to make easier for their 
peers. One group was taught how to add diagrams to word problems, 
another was taught how to identify and remove extraneous information 
from word problems, and the third was taught to rearrange the order to 
numerical presentations of numbers in word problems. Cohen and Stover 
point out that the students in all three groups possessed the math 
concepts and skills needed to perform the "mathematics" of the word 
problems but their increased performance on word problems after the 
instructional treatment demonstrated that the students needed 
comprehension strategies for the word problems. 

As in some of the studies discussed earlier, this study involved 
the students being taught a rule and then having to apply it. Each 
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group of students dealt with only one of the structural variables in 
their training and so they were not even having to choose among rules 
in their instructional sessions. They were not involved in generating 
or testing the rule but only in applying it. The students engaged in 
the first experiment who rewrote problems to make them easier for 
others would seem to have gone through the cycle of critical thinking 
as they had to generate an idea of something they thought would make a 
certain math word problem easier for others and use this in rewriting 
the problem. 

Andre* and Anderson (1978) taught students how to generate their 
own questions about text materials being read. In order to do this, 
students needed to be able to identify the text structure, especially 
in relation to main ideas. Students were given a description of the 
technique and the steps involved and then practiced generating 
questions for paragraphs and comparing their questions with the 
researchers * questions for the same passages . The steps involved in 
generating questions were 1) to identify the main idea of the 
paragraph; 2) to form questions which asked for new instances of ideas 
and/or concepts; and 3) to ask a question about a concept in the text, 
but in a paraphrased format, if generating a new instance was difficult 
or inappropriate. This self-questioning strategy does appear to 
involve the critical thinking strategies of deduction and induction. 
The reader is asked to deduce questions based on predictions of new 
instances from the main idea and then to continue reading, searching 
for answers for those questions. What is not explained in the 
procedure is how the reader deals with predicted questions which cannot 
be ar.swered in the text or how the reader comes up with the main idea. 
While the reader might hypothesize the main idea using the process of 
abduction, that is not what appears to happen in this study. The main 
idea appears to be stated directly at the beginning of the passage and 
the reader is not involved in hypothesizing and testing out what the 
main idea is. Students who went through this procedure were then 
tested on the main ideas and details in the passages and were expected 
to come up with the researchers' interpretation of the passages. This 
was also true in the training procedure where even the questions 
generated by the reader were measured against the researchers' 
questions. The researchers are the ones who engaged \n abductive 
reasoning and the readers are now expected to match thf*ir thinking with 
the researchers rather than reasoning it through on their own. 

Schumaker, Deshler, Alley, Warner, and Denton (1982) taught 
students labeled learning disabled a learning strategy called Multipass 
which required students to make three "passes" through a chapter for a 
particular purpose. Each pass involved a different use ol the text 
structure of that chapter. The first pass, Survey Pass, involved 
skimming titles, introductory paragraphs, headings, illustrations and 
summaries and then writing a paraphrase of the information gained. The 
second pass, Size-Up Pass, required students to read the questions at 
the end of the chapter, look through the chapter for textual cues and 
then make the cues into questions, skim to find the answers to the 
questions, and paraphrase the answers to the questions. The last pass, 
Sort-Out Pass, involved the students answering the questions at the end 
of the chapter and skimming the section they thought the answer would 
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be in if they could not answer the question* The students went through 
a series of instructional procedures in which the strategy was 
described and modeled and then rehearsed and practiced wxth feedback in 
various materials. 

While it would appear that this strategy should involve the three 
critical thinking processes, the way in which the strategy was 
presented and tested by the researchers made it an application of a 
rule rather than a reasoning through of a rule. The first step, Survey 
Pass, could be a generative step where the reader would generate an 
hypothesis that would then be broken down into possible predictions 
using deduction and tested out using induction during the last two 
passes through the material. However^ the researchers required the 
students to come up with the researchers' "correct" answers in each 
step of the teaching of the strategy and emphasized remembering facts 
from the chapters being read in the testing done to evaluate the 
effectiveness of the strategy. Thus, students were expected to take 
and apply a rule given to them by the researcher rather than to 
generate and use their own hypotheses - 
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Researchers have explored a wide variety of instructional 
procedures to teach inferencing during the reading process. Rowe ii. 
Chapter 7 points out that slightly more than one-fourth of the 
instructional studies focusing on processing strategies in the (JSOE 
data base had a dominant focus on inference instruction- 

Hansen (1981) tested two instructional techniques designed to 
develop readers' abilities to draw inf*irences between print and prior 
knowledge. The first method, the Strategy method, was based on a 
weaving metaphor. The experimenter selected three important ideas from 
the story and first asked questions of the children which related to 
some possible previous experiences they had had and then asked them to 
hypothesize something similar that might happen in the story. The 
hypotheses and previous experiences were written on slips of paper and 
actually woven together to illustrate the strategy of integrating the 
new with the known. The second strategy, the Question method, involved 
asking only inferential questions to the group after the reading of a 
story. 

The Strategy method did involve students in generating hypotheses 
although the strategy stopped at this point and did not go on to 
encourage students to make predictions based on these hypotheses and 
then test out the hypotheses during reading. It appears that the 
researcher did assume that this was what students did as they read. 

The Question method used inferential questions at the end of 
reading. It may be that students began to anticipate this type of 
question after a number of stories and began reading looking for 
anomalies and attempting to deal with them because of the awareness 
that they would need to answer inferential questions after reading. 
However, this strategy does not appear to directly deal with developing 
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critical thinking strategies. Although the first strategy does appear 
to concern itself with critical thinking strategies^ the tests used to 
treasure reading comprehension at the end of the study involve the 
student being measured against what the researcher has determined atv 
the "correct" inferences and so do not fully measure the gams in 
critical thinking made by students during the instruction- 
Gordon (1980) developed two instructional strategies aimed at 
improving reading comprehension through more active involvement of the 
reader- The Inference-Awareness Group were taught how to use cues from 
the text and from their prior knowledge in order to draw inferences 
during reading- This involved a step-by-step modeling and feedback 
technique in which the teacher began by r-tating both the inference and 
the examples that supported it, moved to stating only the inference and 
having students find the supporting examples, and then finally to 
students generating both the inference and finding the examples - 
However, while the students were gradually moved to independence from 
the teacher, even in the last step the teacher asked a question which 
required the students to make an inference so the teacher was still 
introducing the anomaly rather than the students- This strategy 
appeared to be primarily focusing on the critical thinking strategy of 
induction, on how to test out an inference or hypothesis by looking for 
supporting examples. 

The second group, the Content and Structure Group, developed the 
students* background content for each story and awareness of the 
superordinate text structures for the story- Background knowledge 
considered to be important to the story was developed through various 
kinds of prcreading activities such as analogies, word associations, 
semantic mapping and examples of word definitions- Instruction in 
structure consisted of a teacher-directed search for superordinate 
statements tor each category in a narrative story grammar. The teacher 
attempted to help children build an abstra^ w general schema for how 
stories are organized- The children were gx 'en the overall diagram of 
the story structure and asked to fill in some of the slots which had 
been left empty^ The teacher is the most acti 'e reasoner in this 
instructional strategy- In the structure part of the strategy, 
students are simply applying a rule that is a gi »cn, rather than 
testing out the model of story structure being used. The prereading 
strategies would appear to give students some additional information 
that they could then draw upon during reading in order to make 
hypotheses and predictions. However, while these strategies appear to 
facilitate abduction and deductioii, they do not appear to directly work 
at developing these critical thinking strategies as the inferencing 
strategy did for induction. This is also reflected in the findings 
which showed on several tests that the Inf crence^Awacencss group made 
greater gams than the Content and Structxirc group. However, the 
testing used to measure the effects of the study again are closed 
measures of reading where the researcher is measuring the reader's 
comprehension agoinst a "correct" interpretation and so docs not fully 
measure the critical thinking of the students* 

Idol-Maestas (1983) taught students labeled learning disabled to 
use a strategy involving guided probes before they began to read. Tlie 
strategy was based on the acronym^ TELLS Fact or Fi« Lion. The strategy 
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involved guessing general story context from the title» scanning for 
clues to general context and difficult words, determining setting, and 
deciding whether the story was fact or fiction. The researcher 
believed that this strategy would activate students' prior knowledge 
and improve both literal and inferential comprehension. 

This strategy appears to be primarily an application of a rule. 
The strategy involved some specific probes in a certain sequence that 
the student was to ask before beginning to read. The prior knowledge 
activated by this strategy would seem to have an effect on the reader's 
ability to generate hypotheses and deduce predictions during reading as 
the reader was more aware of relevant information to draw upon. The 
testing involved in this study consisted of responses to specific 
questions over passages the students had read which again limited 
information about the students* reasoning processes. 

Wixon, Yochum, and Bosky (1984) taught basal stories with the aid 
of either traditional lesson activities or revised activities that 
focused on concept development, predicting the relationship between key 
concepts and story ccntent, and inferential reasoning. Instead of 
traditional vocabulary lessons, students in the revised lesson were 
asked through teachej questioning to identify the critical attributes 
of the concepts, differentiate examples, and to provide definitions and 
examples of the concepts. This strategy appeared to primarily 
emphasize deductive reasoning. The teacher had generated the idea and 
guided students through how to deduce the components of that idea. 

\ During the guided reading, students in the revised lesson were 
asked to generate predictions about how the vocabulary words would be 
used It) the story. These prediction were written down and then checked 
for accuracy as the child read the story- Following this, a discussion 
was h<*ld in which students had to support their conclusions in regard 
to th^r accuracy of their predictions with evidence from the story. 
This ^^trategy does appear to invoice the three components of critical 
thinking m that the child generates an hypothesis' based on the 
voc/ibulary words and then reads the story using deduction and induction 
to/ test the hypothesis or prediction out. 

i 

The review activity for the revised group was to complete a 
reasoning guide, (llerber, 1976) Students had to indicate the accuracy 
of inferential statements and identify a page number in order to 
support their judgment. This strategy seems to continue the emphasis 
on inductively testing out hypotheses through examining the evidence. 

The revised activities did result in the students' scoring higher 
on the comprehension measures. These measures included a free recall 
scored according to a template developed by the researchers and answers 
to open-ended questions. 

Carr, Dcwitz, and Patbcrg (1983) used three procedures to help 
students increase inferential reading comprehension with expository 
text: a structured overview to activate background knowledge* and 
organise text information, a cloze procedure to develop inf erencing, 
and a sclf-monitoring checklist to help students learn to use the 
strategy independently. 
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The structured overview appears to be one way to facilitate the 
critical thinking process during reading because of the resources it 
provided for the reader to draw upon. The cloze procedure produces 
anomalies so that the reader must hypothesize an answer and then test 
out the answer through further reading or thinking. One factor that 
xoav have had a negative impact on the critical thinking process in the 
cloze strategy used m this study was that there appeared to be an 
emphasis on finding the one right answer for the blank. The self- 
monitoring checklist gave students a way to monitor for anomalies and 
strategies to use in testing out hypotheses. Unfortunately, the 
dependent measures were only of a closed nature consisting of literal 
comprehension questions and textually implicit questions which accepted 
only one answer » again limiting the information available about the 
students' critical thinking strategies. No open-ended assessment 
device:; were used. 

Patching, Kameenui, Gamine, Gersten, and Colvm (1983) developed 
an instructional strategy in which they attempted to directly teach 
students critical reading skills. The strategy used to instruct 
students consisted of systematic instruction in which the teacher gave 
t^e student the rule severe! times, had the student repeat the rule and 
then gave the student several examples to work through using that rule. 
While the authors purport to be teaching students how to think 
critically as they read, the strategy they use to teach the students 
critical thinking consisted of having the student literally repeat 
after the teacher and directly apply the rule given by the teacher. 
The rule is a definite given. The student is not testing the rule out 
but simply applying it exactly as the teacher has directed the student. 
The measures used to assess this instruction are based on a closed view 
of language and do not test comprehension in general but only the 
specific critical reading skills taught to the treatment group. 



ERIC 



MACRO-OPERATORS 3 CAl?CqRl2INC OR SUMMARIZING TEXTS 

The studies coded into this category attempt to cither teach 
students som- method of learning to use story grammars in comprehension 
or of summarizing and chunking the information being read. These 
teaching strategies deal with very broad ways to look at the overall 
structure of a text or story. 

Gordon and Braun (1982) attempted to t<?ach students a story schema 
to sec if it would serve as a transferable framework for storing and 
retrieving information from stories, for answering questions, and for 
generating information during writing. Students were first exposed to 
a simplified organizational structure for narrative stories and asked 
to fill in some of the categories with specific story content for each 
story read. Questions were asked first by the teacher and then by 
students prior to reading the stories. The last sessions involved the 
students writing narratives in terms of the text structure components. 

The treatment is described briefly in the published journal 
article so it is difficult to tell if the students were simply applying 
a rule given to them by the teacher or if they moved into critically 
thinking on their own as they began asking their own questions before 
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reading based on what they knew about narrative structures. 

Singer and Donlan (1982) taught students a problem-solving schema 
for comprehending short stories which included a list of schema-general 
questions for each story element in the schema. Students were taught 
to derive their own story-specif ic questions from the schema-general 
questions as they read complex short stories. The purpose of teaching 
the strategy was to teach students to read to find answers to their own 
questions and to give them a technique to generate these questions 
through the use of a general schema for short stories. The students in 
this group were shown content-general questions from which they could 
generate content-specific questions for the stories they were reading 
and each day submitted lists of content-specific questions according to 
what category in the schema they fit. 

This instructional strategy appears to give students a way to 
generate and test out hypotheses as they read. Specifically the 
strategy seemed to involve deductive reasoning as the student deduced 
appropriate specific questions from the general questions for each 
category. The mstru^-tion had some elements of having students apply a 
rule given by the researcher. This is also apparent in the testing in 
which students were expected to come up with the researchers* point of 
view in order to be scored as correct. 

3ean^ Sorter, Singer, and Frazee (1983) taught students a 
metacognitive strategy for summarizing text materials through using 
graphic organizers or outlines. Students in one group were taught a 
three-step procedure for creating a graphic organizer of concepts 
pr<*srntcd m their history text. Following an initial demonstration, 
students engaged in guided practice creating graphic organizers in 
small groups and then individually and were given feedback on their 
organizers by the teacher. Another group of students generated 
traditional outlines of lesson concepts. The same procedures were used 
to teach this group except for the j^cneration of an outline rather than 
a graphic organizer. Both procedures seem to involve primarily 
applying a rule supplied by the teacher rather than testing out a rule 
through critical thinking. 

The measures used to assess the effectiveness of the two 
strategies included multiple-choice questions concerning literal 
details and a summarization task. In both cases, the students had to 
come up with an interpretation that matched the researchers' 
interpretation of the text. The graphic organizer was a more effective 
strategy than the outline for students as measured on these 
instruments. 
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Ttansmediation studies involve movement from one communication 
system to another. In these studies, the movement is from a 
t^ommunication system involving written language to another sign system 
such as mental imagery or drama. Each sign system has its own 
strengths and limitations in expressing meaning and expresses meaning 
in a way unique to that sign system. (Eisner, 1982) This movement to 
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expressing ceaning in another sign system encourages readers to Lake 
another perspective on what they know and to therefore construct new 
understandings and connections between ideas. This movement thus al^o 
facilitates the critical thinking process of abduction and encourages 
new connections between ideas for the reader. 

Lesgold, McCorxnick, and Golinkoff (1975) taught students to draw 
stick-figure cartoons about the stories they were reading. These 
sketches were to focus on the main ideas of the story and were drawn 
over a five-day sequence in which, on the last day, students were asked 
to XToagine their cartoon rather than draw it. They were also taught to 
use the cartoons as a recall prompt for main ideas and details Irom the 
story. 

This encouragement of the use of imagery during reading would seem 
to affect the reasoning process in a number of ways. The change in 
perspective offered by switching to another sign system would seem to 
be particularly generative in producing hypotheses about anomalies. 
Peirce talked about the use of mental diagrams in the deductive process 
and imaging could also probably be used as one way to test out 
hypotheses. Thus imaging could facilitate all three components of the 
critical thinking process, although its primary effect would seem to be 
in relation to abduction. 

Pressley (1976) taught children to make images by telling them to 
make up pictures in their heads for sentences or passages from stories 
and then showing them slides of what their pictures should look like. 
While this strategy encouraged imaging, it also attempted to limit the 
imaging being done by children to a certain standard or replica of the 
imaging of the researcher and so limits the abduct ive process of the 
reader. 

Finch (1982) also asked students to make pictures in their heads 
and then had the students describe their pictures. The accurateness 
and completeness of their mental xmages were discussed with them by the 
researcher. The researcher attempted to emphasize making images after 
reading rather than during reading, a process that would not seen as 
facilitative of the critical thinking process. The most interesting 
finding of this study was on a quest ionnai re J.}>at Finch administered 
after the testing m which she discovered that the majority of children 
in the control group had spontaneously used mental imagery while 
reading. This finding clearly challenges researchers who believe that 
students in control groups are not using certain strategies because 
they have not been taught to do so or that students necessarily learn /i 
strategy from the instructional procedure. They may already be 
spontaneously using the strategy before instruction. 

Siegel (1984) introduced a strategy called "sketch to stretch" 
where students were asked to draw their interpretations of a variety of 
written materials. The directions they were given were to "draw what 
the story means to you" or "draw a sketch that explains what the 
article means." Sketching was seen 4is o learning strategy in which 
children could use art to think about what they had read. Students 
were given an opportunity to explain their sketches to other children 
during a sharing time. Directions were given to the children to 
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encourage them to use the sketches as ways to synthesize ideas rather 
than simply retell the story. These sketches were not held up against 
a model created by the researcher and so this strategy appears to be 
more open-ended and generative than some of the other strategies 
involving art. All the components of critical thinking are involved in 
this instructional strategy. The students are faced with an anomaly in 
having to move to ai^other communication system and so generate an 
hypothesis about how to express meaning in this different system. This 
hypothesis is explicated and tested out as the students sketch and 
share their sketches with others. 

Henderson and Shanker (197B) used another type of transmediation, 
interpretive dramatics, as a way to involve students in all three 
components oi critical thinking. Dramatics was used as a follow-up to 
basal stories in order to develop comprehension skills. After reading 
a story* the group d^^scussed the characters needed and decided how each 
person would participate (actors or directors). The miianing of the 
story was not altered although the same words were not always used us 
found m the story. Students were faced with an anomaly and had to 
generate hypotheses about how to express the meaning of the story 
through drama and then deduce from those hypotheses specific decisions 
about characters. They first developed a general idea of how to 
dramatize the story and then had to deduce the specific ideas necessary 
to carry ouL the general idea. Following the first dr/im-tization, the 
teacher and students discussed how well the story had been interpreted 
and then another group acted out the story followed by more discussion 
to review what had been accomplished. The students were testing out 
their ideas through induction by both dramatizing the story and 
discussing the resulting interpretations. 

Wittrock and Linden (1981) used a strategy that involved students 
generating associations between the text and their experiences and 
bf»twecn the different parts of the text. Students were asked to 
generate text-relevant images, illustrations, analogies, metaphors or 
summaries as they read stories on different days. They were then 
tested using a multiple-choice test of factual information and 
completion tests of reading comprehension. 

The strategies introduced to the students would seem to be 
generative in relation to the three components of critical thinking, 
especially in relation to abduction. However, the measxires used to 
assess this treatment do not measure this effect on reasoning but 
instead look at a literal level of recall. 



This category contains studies which look at the effect of 
metaphors or analogies on reading comprehension. In the only 
instructional study identified in this category to date* Hayes and 
Tierney (1982) attempted to help students build a bridge between the 
knowledge they already possessed and new information. Students were 
presented analogous information in a passage on a related topic or in a 
passage that specifically drew an analogy between the old and new 
iniormation. The provision of analogies was helpful to students as was 

„ 156 



LANDSCAPES: CRITICAL THIKKINC 



7:20 



a passage related to the new information but which did not contain 
specific analogies. Building background through presenting information 
related to the topic to be learned influenced students • comprehension 
and learning from text. 

Peirce saw analogies as an example of critical thinking that 
involves all three components of the reasoning process. Involving 
students in using analogies during reading can thus be seen as a good 
way to get them actively involved in critical thinking. Hayes and 
Tierney point out that analogies allow the reader to transfer the 
properties of the known ideas to the new knowledge and create new 
knowledge structures which are linked to the old structures. 

Crafton (1981) also looked at how one piece of text can support 
another text. Students read two expository texts in one sitting. In 
one group» the two texts were conceptually related and in the other 
group » the two texts were conceptually unrelated. The findings of the 
study indicated that reading was an experience which made available 
background information for use during another reading encounter. 
Students who read the conceptually related texts comprehended the 
material at higher levels, focused on the meaning of the texts to a 
greater degree, and were more active during the reading process than 
subjects who did not read conceptually related materials- This 
strategy suggests that having students read related texts will 
facilitate their ability to generate hypothesis and deduce possible 
predictions to be tested out during reading. This study is also a good 
example of the use of dependent measures which were based on a more 
open view of langaugc and which did not measure the comprehension of 
students against only the researcher's interpretation of the written 
text. 



Pcirce defined critical thinking as thinking that Involves an 
attempt to try and match what a person thinks with what actually 
exists. It involves inferring the truth of something. This chapter 
attempted to use Peirce 's definition of the three components of 
critical thinking - abduction, deduction, and induction - to provide a 
new lens for examining reading comprehension and to see if 
comprehension strategies in current instructional research were aimed 
at getting students to use reading as a critical thinking process. A 
number of major concerns emerge from the use of this new lens that both 
teachers and researchers need to take into account- 

An examination of instructional strategies in reading 
comprehension research revealed that frequently the teacher is the 
person who benefits from active reasoning during these strategies. The 
generation of hypotheses is usually done by the teacher and not by the 
students- Often only one aspect of the three components of the 
critical thinking cycle proposed by Peirce was included in an 
instructional strategy and usually the process of abduction was 
omitted- Thus students were not involved in the one component of 
critical thinking which can originate new ideas. Peirce emphasized the 
mterdependency of these three components of critical thinking and yet 
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lew strategics used that inLerdependency but simply taught inductive or 
deductive reasoning separate from the rest of the cycle. 

Critical thinking involves generating and then testing out an 
hypothesis or rule. Many of the instructional strategies involved 
simply having the reader apply the rule. The rule was a given and was 
not being tested out- The reader was to take what he/she knew and use 
It. Other strategics operated at a literal recall level where the 
reader was simply to use memory to tell what he/she knew. In neither 
case was there an involvement of the reader in critical thinking 
through examining ideas. 

In research where the strategics did involve critical thinking, 
often the critical thinking was not measured. Comprehension was 
usually assessed in such a way that the generative nature of abductive 
reasoning was denied. Strategies such as imaging or inferencing which 
involved abduction were tested as if they were deductive instead. 
These comprehension assessment measures tended to take a closed view of 
language where the readers* interpretation of the passage had to match 
the researcher's interpretation. There is a tremendous need in the 
field of reading education for better assessment measures which arc 
more open-ended and measure the gcnerativencss of thinking. 

There were some promising strategics in these studies which offer 
teachers insights into how they might teach critical thinking 
strategics i * the classroom, especially in inferencing and 
transmcdiat ion. Each of the three components of critical thinking 
accomplishes different things and encourages different types of 
thinking. In order to accomplish the different purposes of thinking, a 
reader needs to be able to use all three components of critical 
thinking and so teachers need help finding ways to develop the entire 
cycle of critical thinking in their classrooms. 

While some help is available in instructional research in reading 
comprehension, most of the instructional research currently available 
tQ teachers do not provide them with sources of strategies they can use 
to enhance critical thinking. The lack of instructional strategies in 
reading comprehension research that enhances critical thinking and 
reading has several implications for teachers and researchers. 

Teachers need to be critical thinkers themselves as they read 
research in order to evaluate whether the strategies utilized in 
treatments do enhance critical thinking. They also need to become 
their own developers of curriculum that supports the critical thinking 
and reading processes of their students. The example from the first 
grade classroom at the beginning of this chapter would seem to indicate 
that if children arc in a classroom where they are allowed to develop 
their own interpretations of texts, rather than having to answer 
specific questions designed to make sure that their interpretations 
match the teacher's, they more actively and critically engaged in 
reading that text. Students need to be placed in situations where 
they face some type of surprise or anomaly which they must deal with 
such as in the "Sketch to Stretch" strategy described earlier. 
Teachers m the past have operated under the assumption that giving 
students a generalization or rule on how to proceed was helpful to 
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students but Pcircc's discussion of critical thinking helps us to now 
see that it inhibits critical thinking* and co restricts reading to a 
process of dealing with unexamined ideas. Students as well as 
teachers need to be critical thinkers and generate hypotheses to test 
out. 

Teachers and researchers need to reexamine the types of 
instructional strategies they are currently studying and the 
theoretical base of these strategies based on the concerns raised in 
this chapter. They need to study strategies where students generate 
and test out hypotheses rather than simply applying a given rule handed 
to them by the researcher or teacher. A major concern which teachers 
and researchers need to deal with is how to go about measuring the 
effectiveness of strategies so that the generativeness of critical 
thinking is not lost. The current practice of measuring effectiveness 
by matching the students' interpretations of a text against the 
researcher's own "correct" model has limited the types of strategies 
which have been utilized as a treatment and has resulted in producing 
findings which do not measure the critical thinking involved in 
strategies which had the potential of enhancing critical thinking. 
Teachers and researchers need to closely examine studies which have 
taken a more open view of langaugc and attempt to continue to develop 
assessment measures which are based on this view of language. 



COiVCLUSION 

A major source of concern about comprehension instruction and 
instruction in schools in general is that education does not encourage 
students to doubt the rule or an authority's ideas. Students are to 
take a rule or idea as a given and apply it exactly as it was handed 
to them rather than to test it out. Measurement and assessment 
techniques also encourage students to not doubt the rule or idea. 
Peirce demonstrated that generating and testing out rules or hypotheses 
IS how the critical thinking process occurs. The lack of opportunity 
for this in many classrooms and schools is cause for great concern if 
we truly want schools to be places of learning and thinking and reading 
to be seen as a critical thinking process. 

Chapter 8 will take a different perspective on the kinds of 
implications for instruction we found in current reading comprehension 
research. This chapter will take you on a guided tour of the landmarks 
of the landscape^ the instructional studies which were identified as 
exemplary. 
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LANO^SARKS OF COMPREHENSION INSTRUCTION: 
EXEMPLARY' STUDIES EOR TEACHERS TO USE 



Karin L. Dahl 
University of Cincinnati 



and 



Barbara Roberts 
Glooscap Elementary School/ Canning/ Nova Scotia 



INTRODUCTION 



A team of researchers whose task was to read and analyze the body of reading 
cotrpre hens ion research from the past ten years was meeting to discuss studies. 
Each researcher «'as considering a synthesis paper that looked at some iitportant 
aspect of reading conprehension. The table was stacked high with studies being 
categorized and considered. The team, working together as they had for so many 
aft^moons/ was ready to discuss whatever tcpics seemed inportant. 

Looking at the stacks/ I sighed/ "You know/ what I'd really like to 
write about is classroom instruction. I'd like to synthesize the 
exenplary studies for teachers." 

"Fine/" said Diane/ "but hew would you choose exenplary studies - what 
guidelines would you use?'' 

•Well/ first the studies need to have a significant bearing on the 
classroom/ on what is actually going on during instruction/" I 
asserted. 

"A lot of the studies we've read are more designed to answer the 
researcher's questions than get at actual classroom instructioni " said 
Sharon looking up from her writing. 

"But there are some, studies which deal with classroom settings more 
than others/" I answered. 

Sharon put her writing aside/ "Most of the studies we've read involve 
such snell amounts of time in actual instruction/ .... wouldn't it be 
inportant to choose studies with instruction carried out over extended 
periods of time?" 

"Yes/ but there are studies with short duration which have important 
ideas/" I said. 
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"Let's try this/" said Diane grabbing a piece of chalk/ "I'll write 
the criteria on the board and let's see what you think*'* 

— Significant bearing on classroom instruction 

— Extended period of time in the classroom 

I thought for a moment and added/ "I would like the instructional 
activities to increase students' interest and involvement." 

Diane added 'Increase students' interest and involvement' to the 
emerging list and then paused to consider the set as a whole. 

— Significant bearing on classroom instruction 

— Extended period of time in the classroom 

— Increase students' interest and involvement 

Just then Barbara/ a teacher who had recently joined our research 
team/ walked in. We informed her of what we were doing/ and she 
joined our discussion. 

"I like the idea of including studies that increase students' interest 
and involvement/ but I think studies with 'significant bearing on 
classroom' is too broad- 'Amount and kind of instruction' might be 
more specific." 

"Why do you think so?" I asked. 

"I think teachers need to know the amount and kinds of conprehension 
activities going on in classrooms in order to reflect on their own 
instruction to see if what they are really doing is focusing on 
reading conprehension." 

"That seems like a better guideline because Barbara is concerned with 
what can potentially happen in classrooms rather than just with what 
happened in the research studies/" I thought out loud- 
Diane proceeded to start the list again. 

— Amount and kind of instruction 

— Increase students' interest and involvement 

"How can teachers best increase students' interest and involvement?" 
challenged Diane. 

"I always try to nake the best use of the experiences and resources 
which my students already have/" added Barbara. 

"That's it. I need studies which encourage learners to use their 
prior experiences in relating to the text." 
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Diane seemed to realize that I was satisfied and cx)nnpleted the list. 

— Anount and kind of instruc±icn 

— Increase students' interest and involvement 

— Encourage students to use prior experiences 

''Why don't you and Barbara work on the paper together?" suggested 
Diane. 

"Then teachers would certainly get a teacher-researcher perspective/" 
offered Sharon. 

"That sounds like a great idea/" I added/ "But before I had time to 
ask Barbara/ she started to say.... 

"I've been a classroom teacher for five years and a special education 
resource teacher for eight years/ but I've never worked on a research 
project before. Do you think I'm ready for this?" 

We all assured her that she had much to offer/ and before the meeting 
was over Barbara and I had agreed to work together on the synthesis 
paper of exeiiplary studies for teachers. 

Thus we attenpted to choose the reading comprehension exemplairy studies 
with the following guidelines: (1) amount and kind of instruction; (2) increase 
students* interest and involvement; and (3) encourage students to use prior 



_ criteria. Nevertheless/ because these categories proved used useful in our 
discussions, we decided to keep them. We invite you to be flexible in changing 
the grouping of these studies to suit your needs in various situations. To 
assist you/ we have provided preview sumnBry tables before discussion of the 
studies. You might like to put certain studies in all three major tables which 
we have constructed/ and/or create new charts and tables which help you see 
quickly and easily landrarks in the current state of reading connprehension 
instruction. Our coiiprehension research suggests that the creation of such 
previews/ sumnaries and visuals make text more conprehensible. 



It proved especially useful to look at the amount and kind of instruction. We 
hope to demDnstrate that; (1) too often the evaluation becomes the instruction/ 
leaving little time for actual reading comprehension instruction; (2) there is a 
need to make use of prior experiences and social-cultural patterns of learners: 
and (3) there are interesting ways to vary traditional basal reading activities. 
Studies which will be discussed in this section are sumnarized as follcws: 



experiences. 




nany studies fit all three 



AI^KXJNT AND KIND OF INSTRUCTIO?^ 
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Author 



Table 1 
Exenplary StucJies 

Amount and Kind of Ccnprehension Instruction 



Durkin (1979) 



Leinhardt/ et al, 
(1981) 

Mascn (1983) 



Tharp 
(1982) 



Au Sc Mason 
(1981) 

Wixson, Yochum & 
Bosky (1984) 



Little time on instruction because teachers were 
attending to assessment and worksheets 

Little time on instruction of learning-disabled 
because too much time on nonreading activities 

Lessons omitted introductions and discussions: 
reading/ writing, and subject matter activities 
that follow direct instruction were not 
substantial 

Maxinum conprehensicn instruction 
using leaiming stations and adapting to the social- 
cultural patterns of learners in the KEEP Program 

Aciipting instruction to fit the social- 
cultural patterns of learners 

Revised basal activities which focus on 

concept development; predicting relationships between 

key concepts and story content; and inferential 

reasoning 



Current Amount and Kind of Instruction 



Durkin (1979), Leinhardt, Zigmond, Cooley (1981), and Mason (1983) looked at the 
amount and kind of oonprehension instruction currently existing in classrooms. 
They all suggest the need for more actual comprehension instruction. 

Both Durkin (1979) and Leinhardt et al. (1981) held that time spent in 
instruction was critical to achievement. Durkin concluded after extensive 
classroom observation that little conprehension instruction actually took place; 
teachers were instead attending to assessment of comprehension and 
administration of written worksheets. Leinhardt et al., looking at eleirentary 
classrooms for the learning-disabled, found a similar pattern: students engaged 
in nany nonreading activities during reading time. Both recommended that 
teachers increase the amount of direct reading conprehensicn instruction. 

Mascn (1983) observed classrooms in order to find whether a typical 
sequence of instruction existed and found that few classr'^oms lessons contained 
complete text-related sequences (introduction, reading, and discussion). 
Instead, teachers omitted either the introduction or discussion and substituted 
other events unrelated to the text. Mason suggested that alternative activities 
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for inc3ependent work could include learning stations offering significant 
reading/ writing and subject natter activities* 

Clearly/ the recorrfnendations from these three studies s.jgest that teachers 
need to shift from assessment and work-sheet dominated conprehension activities 
to enphasis on direct instruction of conprehension for all children. These 
findings made us both very reflective, Barbara admitted that in the past she 
had fallen into the trap of the teachers in these studies and had not planned 
much for actual conprehension instruction. We both reflected on the fact that 
members of our research team who are currently out observing in schools had 
recently informed us that in some special education classrooms the evaluative 
instruments have become the curriculum. That is because of the lack of better 
alternatives, teachers sometimes use them as guides for instruction. We are 
finding that there are nany better alternatives for reading conprehension 
instruction which the remaining studies in this paper offer teachers. 



Maximum Comprehension Instruction 

Interestingly/ the recommendations made in the above studies for significant 
amounts of time spent in actual conprehension instruction and inprovement of 
activities through learning stations are landmarks of the next study by Tharp 
(1982), Both Tharp (1982) and Au & Mason (1981) stress the inportanoe of prior 
experiences and social- cultural patterns of learners in instruction, 

Tharp (1982) discusses the KEEP program in which time allocations are 
designed to provide a naxinum amount of direct conprehension instruction for 
snail groups while other students work at 10-12 learning stations. The KEEP 
program monitors the amount of time spent on conprehension instruction daily. 
Teachers use ETR (experience/ text, relationship) sequences to guide lessens: 

E The teacher introduces content drawn from 
the child's experience, 

T Text material is then read, 

R Discussion is conducted to establish 
relationships between the child's 
experience and the text. 

There is heavy reliance on questioning at various cognitive levels and the 
participation structures which fit social cultural-patterns of learners are 
infornal/ allowing learners to contribute to one another's answers and generate 
group rather than individual responses. The KEEP Program thus incorporates the 
following elements: active instruction of conprehension (nearly 66% of 
face-to-faoe instructional time devoted to comprehension)/ classroom instruction 
in snail groups (with multiple participation during ETR sequences), and 
independent prescriptive work in learning centers. 

We both agreed that the najor landmarks of the KECP Program were: (1) the 
amount of actual time spent cn conprehension instruction; (2) the learning 
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station concept v/hich provided an excellent exanple of hew to nake independent 
work ireaningful: arri (3) the planning for instruction around prior e-xperiences 
and social-cultural patterns of the learners. This program*s acfeptatico of 
instruction to the social-cultural patterns of ^he learners further confinns 
earlier findings of Au and Mason (1981). They cornpared the school achieverent 
ot students receiving instruction where students wait to be called on to speak 
one at a tiine wit:h patterns allowiiig students to share turns in joint 
perfornance (contnon in their Hawaiian culture). Achievement was nuch higher 
when social-org^inizational factors fitted the cultural patterns of learners. 
They concluded that any kind of instruction should balance interactional rights 
between teacher and children. 



Revised Basal Activities 



while Tharp's (1982) KEEP Program is an exenplary study, Barbara felt that the 
three strands of instruction (conprehension, sight vocabulary and (^coding) 
could be inproved because this kind of instruction was too nuch like nany 
standard basal activities which do not encourage enough higher level thinking. 
I suggested that the Wixson, Yochum and Bosky (1984) study should prove most 
useful to teachers. As Short (chapter 7) has denonst rated, their revised basal 
activites engage students in the three inportant oonpcnents of critical 
thinking. 

Wixsc^n, Yochum & Bosky (1984) contrasted two approaches — standard basal 
acuvities and revised basal instruct.icr*. A description of these two approaches 
follows: 



Table 2 

Traditional versus Untraditional Approadies to P'>ading Ccnprehensicn 



Stan^rd Basal Activities 



Revised Basal Activities 



Pren^ading vocabulary: 



Teacher introduced words in 
sentences written on 
the board. 



Students identified 
critical attributes of 
essential concepts/ providing 
exaiTples and ncn-^xarrples. 



Guided reading: 



Teacher introduced a 
general purpose-setting 
qwstion and students read 
silently. Later/ the 
questions after reading 
xfcre answered by rereading 
ctcry sections orally. 



Student:^ generated predictions 



about each vocabulary word's 
relation to the story. The 
written predictions were 



evaluated for accuracy after 
silent reading. 
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Follow-up: 



Worksheet cxi skill 
developnient {sequential 
order of events) was 
ccnpleted* 



Reasoning guides were 
corrpleted in whidi students 
labeled inferential statements 
as acxuate or inaccurate and 
provided supportive story infor- 
nation for their judgnent. 



Based on the responses of students to free-recall and c^n^-ended questions, 
these researchers concluded that the kind of instructional activities that 
acconpany basal lessens shape the natu*.iB of resulting story conprehension* Both 
Kinds of instruction facilitated conprehension, but revised basal activities 
produced significantly higher quality responses to ccxrprehension questions and 
nore focus on central stcxry infornation* Thus, instruction whidi focused on 
concept develoijment, predicting relationships between key concepts and stc»ry 
content, and inferential reasoning was shown to enhance children's conprehension 
beyond the level achieved with traditional activities. 

We txDth noted that the findings of Wixson, Yodium and Bosky further confirm 
the need to rethink comprehension instruction^ We were not surprised that the 
revised Dasal activites produced higher quality responses because each of the 
three activities conprising the lesson fornat focused on critical thinking 
through active stucfent involvement. 

In the first revised basal activity, the teacher had stu&nts identify 
critical -^ttritxites of essential concepts and provide exanrples and non-exarr^les. 
In the next i-evised basal activity, the teacher encouraged higher level 
thinKing by having the students generate predictiOTS about each vocabulary 
word's use in the story and to use these predictions to evaluate for accuracy 
after silent reading. In the third revised activity, the students demonstrated 
their ability to label inferential statements as accurate or iraccurate by 
providing supportive story infccnation. 

These activities scand in contrast to the standard basal activities 
reported in Table 2 which appear to be similar to what Durkin (1979), Leinhardt 
et al, (19S1) and Mason (1983) report in Table 1 as the nore general kinds of 
activites that have been going on during reading instruction. In none of these 
nore traditional activities are students encouraged to generate their own 
re^>cnses. 

This set of studies made us realize that many traditional reading 
conprehension activities do not increase students' interest in the content area 
and involvement in critical thinking. As a result we were nore motivated than 
ever to find useful studies for teadiers which offered alternative activites 
which increase students* interest and involvement. 
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Need for Reflection 



Before we nove on to the next studies, we would like to present you with 
questions which resulted from our reflections en the studies we have reported. 
They are designed to increase your interest and involvnent in the teaching of 
reading conprehension in your classrooci. 

!• Are you spending enough time on actual reading coiiprehensicn instruction? 

2. Are children labeled special education in need of different oonprehension 
instruction than other children? 

3. Are children labeled special education given even more nonreading activities 
than other diildren during instruction? 

4. Given what we know about the process of reading conprehension, are 
children's labels useful for planning appropriate instruction? Aren't all 
children special in that they coire to us with unique prior experiences and 
social-cultural badcgrounds? 

5* Won't these unique prior experieoes OBan that different activities may 
increase interest and involveirent for different students? 

6. Have you thought about setting up learning stations to help d^al with these 
iinique needs? 

7. What kinds of reading* writing, and conceptually-related topic invitations 
ndght ycu extend to students at such learning stations? 

8. Do you plan instruction that encourages creative thinking and inferential 
reasoning? 

9. Dd you plan instruction such that learners are actively engaged in learning 
through doing? 

ID^ Do you plan instruction whid^ encourages social interactions Txxig learners? 

We hope your responses to the atcve questions will enable you to better nake 
use of the studies in the rerainoer of this paper* Barbara's responses have 
certainly done this for her. She is eagar to get back to Glooscap Elementary 
School to try out some of the interesting drama/ art/ preview/ summary/ analogy/ 
and metaphor activities presOTted. 



Since most of Uie studies which encouraged students to use prior experiences also 
increased students' interest and involvement/ any stuc^ in this group could have 
just as easily fit in the next section of this paper. We will present but an 
example of the more activity-oriented studies in the hope that they will spark 
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you to ejcpanJ on and/ or create even more interesting cx>nprehension activities. 
We hope to cJenonstrate that: (1) reading comprehensicxi is nuch nore than 
answering questions at the end of a passage: (2) there are nany nodes of 
expression and subject areaa besides reading whic^i enhance reading conprehension: 
ii/ if learners are going to use effective comprehending strategies! they need 
opportunities to engage in social situations in which they discuss, seek meaning* 
and solve problems: (4) structured overviews/ previews, and flow charts are 
useful conprehension activities: and (5) there are different kinds and ways to 
use suirararies to enhance comprehension. Studies which will be discused in this 
section are sumnarized as follows: 

Table 3 
Exerplary Studies 

Activities to Increase Students' 
Author Interest and Involvement 



Linden & Wittrodc 
(1981) 



Henderson Et Shanker 
(1978) 



Cccrbination of generative activities 
including drawing and naming images/ 
writing summary sentences/ and thinking 
of metaphors and analogies 

Drama as response to literature 



Szabo & Lameill-Landy 
{1931) 



TV as motivational device 



Lesgold/ McCcrmick 
& GclirJcoff (1975) 

Sarpson/ Valmont S 
Van Allen (1982) 

Cohen Ei Stover 
(1961) 

Taylcr 

(1962) 



Graves # Cock S 
Lal^erce (1983) 

Gova 
(1983) 

;\ino<:nrad 

(19e3) 



Learners draw stick figure cartoons 
to recall and retell stories. 

Instructional cloze with students 
verbalizing their thinking 

Students alter nath word problems to irake 
the problems mere comprehensible 

Inportant icSeas surrnarixed in 
in' each pai3graph/ then written into 
outline factn before inclusion in a 
more complete sumnary 

Extended story previews prior to reading 
thios serve as motivational devices 

Constructing flow charts for more careful 
reading of e>pc^itcry text 

Identifying inportant elements in text 
and sumrrarizina 



Hare 5r Bcrchardt 



Suimarizing rules 
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Multi-TOdal Processing 

Yestercfey Barbara interviewed a teacher whom she will observe teaching reading 
conprehension. The teacher suggested that her najor approach to reading 
conprehension instruction was through asking questions at the end of passages to 
assess whether her students had read and understood. This further confirmed the 
findings of Durkin (1979) and others and nade Barbara even more reflective. 
She adrratted to me that in the past she, too, ted spent too much time asking 
children questions to see if they had appeared to have read and understood. At 
the end of the interview, this teacher did e^qpress a desire to be able to read 
the results of our reading conprehensicsj research. We feel sure that when she 
does, she will see that Linden & Wittro^ (1981) and others suggest nary 
interesting alternatives to the traditional approaches which she has been using. 

As an alternate to answering conprehension questions at the end of a 
pasi>a^. Linden and Wittrock (1981) studied generative ccxiprehension tediniques 
that occur during and after reading. Their premise was that conprehension is 
enhanced when learners buila relationships between text and their prior 
knowledge, Th^ confirmed otr initial discussion with the research team about 
the need to use prior experiences to increase students' interest and 
involvement. They suggested a nunber of strategies to induce readers to attend 
to text, relate knowledge ar.J experience to it and build associations, 
abstrations, and inferences. These strategies included generating text-relevant 
images, illustrations, analogies, metaphors a*id sumnary sentences, A program 
co!ifcining these strategies was oonpared with <± traditional one in which students 
simply read text selections and answered questions. The coirbination program 
involved the following generative activities for a succession of stories: 

Eay 1 — Immediately after reading a story/ stu&nts generated, 
illustrated, and named images for the story. The imaging instruction 
directed students to nake pictures in their minds of everything in the 
story. 

Day 2 — Students oonposed sunnary sentences as they read a second 
story. They considered the story in sections and wrote one or two 
sentences for each part. 

Day 3 — Students generated and wrote metaphors and analogies as they 
read a third stoxry, making connections between the stoiry and their cvm 
experiences. 

Responses on story-centered comprehension tests indicated that learners in 
the generative learning program, produced more text-related associations and 
demonstrated increased retention of facts and conprehension of straies. Thus it 
appears that such innovative activities as inaging, drawing, analogies and 
metaphors have ttuch potential for naking comprehension insttuction more 
effective. Various authors thrcughout this volume deal with studies which are 
exanples of similar interesting modes of expression to enhance comprehension. 
For exanple, Snyder (chapter 10) and Harste {<Jiapter 12) iranticn a study by 
Siegel in which the children recast their their understandings through 
sketching. The studies Henderson & Shanker (1978), Szabo 6 Lamiell-Landy 
(1981) and Lesgold, McCormick, & Golinkoff (1975) are a few examples of 
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research studies which increase students* interest and involvement through 
alternative modes of expression. 

Henderson and Shanker (1978) used creative dranatics as an alternative to 
basal reader workax)k activities to increase conprehension of second graders. 
They used interpretive draoa to lend interest to basal reader stories. Their 
procedure was to hold a pre-drama discussion in which students determined who 
the characters were and what their roles entailed; then students played out the 
drama improvising lines and actions as other students served as directors/ 
irakers of sound effects, and prompters. A discusi^ion of whether critical 
elements of the story were interpreted well enough was followed by successive 
perforrrances until every cxie had participated. The researchers found significant 
differences in favor of the interpretative drama over basal reader workbook 
activies. Moreover the children preferred the draiTB. We feel that this is 
understandable because the children were actively engaged in a social situation 
in which they had opportunites to talk about their problems as they attempted to 
solve them. 

Szabo 4 Lamiell-Landy (1981) used televisicn scripts of not-yetHDroadcast 
prime time television programs as supplemental high interest comprehension 
materials. Over a period of one year, scripts from Mork and Mindy, Happy Days 
and Eight is Enough were used along with oorrpanion oamprehension exercises. In 
tnis case/ interesting material promoted increased attention and more active 
participation. In addition^ students benefited from additional e^qpccure to 
story lines in rehearsals and subsequent program viewing. The authors have 
suggested that viewing popular television shews offers the potential to 
stiirulate a wealth of visual inagery which then can be reinforced upcn 
subsequent reading of the script. Thus it appears that the use of televisicn 
scripts my prove useful for cciiprehension after children have already viewed 
programs. Such scripts also have excellent potential for dramatizing, and other 
social interacticxis amcxig students and teachers. 



Learning Is Social And Must Make Sense 



ERIC 



Based on the observations which our research team have being doing in special 
eckication classes, there does net appear to be enough opportunities for children 
tc engage m social situations which give them opportunities tc talk about their 
problems and attenpt to come to better understandings. Today, when Barbara was 
cut m the schools observing reading conprehension instruction in fecial 
education classes, she noted that most of the instruction was individual. From 
the following exairple ^hich Barbara related to me, it seems clear there is a 
need for more social interactions among learners: 

"This teacher seemshi to read with children individually, discuss the 
stories and ask questions. When I asked the teacher if she always did 
reading in turns with these eight children, she said that she did 
because they were each using different materials. So I asked her if 
she followed the same procedures with social studies. She said that 
she works with them as a group rather than individually in social 
studies. Because I feci that learning is very social, I asked if I 
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cx>uld obser\'e her teaching social studies." 

Through very good intentions on the part of the teachier to meet indiviAjal 
needs/ slie may be cutting children off from some very worthwhile learning 
experiences. We feel sure that this teacher will be very interested in trying 
some of the above ideas and we hope to discuss them with her throughout the 
course of this research project. 

It seems that children need opportunities to learn collaboratively if they 
are going to come to value and use strategies. Lesgoldi MoCormicki and 
Golinkoff (1975) suggest the potential of illustrating story events for inproved 
oorrprehesnicn, but the ctudents in their study did not appear to come to value 
the strategy. They drew stick-figure cartoons to illustrate story events. The 
resulting cartoons focused on infornation from eachi sentenccf shewed events from 
each paragraph, and prorrpted recall of story events. Students participating in 
extended imaging instructions of this sort increased attention to details and 
nain ideas in subsequent paraphrase recall tasks. Hcweverf these i>tudsnts did 
not use imaging when not explicitly directed to do so. Yet, Short (chapter 7) 
suggests that imaging facilitates critical thinking. 

Barbara tried to get her special education children to value strategies and 
found it to be a very worthwhile challenge for her. She had the nost success 
encouraging students to value "making sense" strategies when using her students 
as infornants. She first tried to find out as much as possible about them in 
order to best know when and how to support each learner. The following exanple 
illustrates how Greg came to value "making sense": 

Barbara begain by examining Greg's eanulative records. Because he had 
repeated grades cne and three/ he was in the fifth grade at the time 
she began to work with him. 

After his first year in grade one/ his teacher suggested that he was a 
good thinker but he had to get a better foundation. After his second 
year in grade one/ his teadier said that he was attentive and had used 
his language arts skills. His grade two teacher reported that he did 
fairly well in language arts skills but that his conprehensicn was 
weak. By his first year in grade three both his language arts skills 
and his comprehension were reported to be weak. After his second year 
in grade three/ his teacher reported that he had gained in oral 
reading and coirprehension, but still benefited from a controlled 
vocabulary. His fourth grade teacher reported that he had very poor 
phonetic skills but a good understanding for oral vocabulary. 

Barbara decided to help Greg take a more active involvement in reading 
by redirecting his orientation to print. A major activity which she 
used a close reading strategy which is a variation of the Sampson^ 
Valmont & Van Allen (1982) classroom cloze instructional center. 
Their quasi-cloze lessens focused on the structure of language. 
Discussions explored the various answers that could be accepted. 
Students de.^ccibed their own reasons for particular word choices. 
This verbalization of student thinking heightened student awareness of 
the language constraints surrounding each blank and contributed to the 
success of this instructional approach. 
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The cloze procec3ure used by Sanpson and his colleagues d:>es not 
duplicate the reading process. Because readers are encouraged to 
focus on surface structures by filling in gaps which they have not 
created^ Barbara developed cloze reading strategies using Greg and 
other students as her inforirants (Roberts/ 1984). when using her 
cloze reading strategies/ readers create the gaps by identifying 
unfamiliar text and attenpt to fill in only the gaps whidi are 
inportant for getting ireaning in terms of their reading purpose. 

After working with Greg for a half hour per day three times a week/ 
Barbara asked Greg what he thought about cloze reading strategies and 
other meaning-seeking activi titles which they had been using. He 
said/ "Before this year/ I thought leaxming to read was learning 
vowels/ beginnings/ endings and how to decide the word so you can say 
it right. .Some teachers just taught ycu the first thing/ and told 
you it/ and e^qjected you to keep a hold of it till the rest of the 
year." Greg went on to explain that he never focused upon trying to 
neke sense before. 



The lessons Greg learned from his previous school experienoss about 
reading comprehension are not surprising. From the beginning of his 
school experience he had been confronted with fragments of Janguage 
rather than whole stories and texts to read. The most rewarding thii 
about this exanple is that Greg did come to revalue more functional 
strategies. "I^CW/ when I keep practicing reading/ I can read 
better. " 

He discussed and talked about this strategy so much that when other 
chidren used the strategy/ they often said that they were using 
'Greg's Strategy.' Greg's grpwth led other children to grow. 



Text Structure 



Besides coming to better understand potential taskS/ the reading process/ and 
readers/ teachers will find it most useful to make use of text structure in 
planning for conprehensicn instruction. Considerable research evidence 
indicates that sensitivity to text structure is a najor contributor not only to 
text conprehension but text prodLiction. That is, sensitivity to text structure 
can enhance understanding through both reading and writing. Bartora and I have 
both found that our understanding of reading coirprehensicn has been greatly 
enhanced Uirough our discussions and the writing of this paper. For exanple/ 
each time we made structural changes in the paper/ we seemed to increase our 
understanding of reading comprehension as well as writing strategies. 

Cohen and Stover (1931) have demonstrated that students can change the 
structure of math word probleira to make them easier to understand. Snyder 
(chapter 10) found this study so impressive that she has reported on it in 
detail. Cohen and Stover recognized tliat word problems in mathematics often 
pose comprehension problems. They set gifted students to the tasR of 
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sinplifymg them. Airong the twenty-three elements which stutfents later revised 
were the order of problem elements (students arranged nunbers in the order 
required for appropriate solutions)/ the presence of extraneous inforiratico/ and 
the absence of diagrams. Regular students working the revised word problems 
were markedly more successfull than they had been with the same problems in 
their original formats. 

The obvious next step was to teach these regular students to do this kind 
of analysis and simplication themselves/ thus increasing their own 
conpre lension. Rather than generating their own ways to make the problems 
easier, students were told to see if they could eliminate extra infornation^ 
reorder the numbers or add diagrams. Some practice on each technique was 
provided and students applied their new comprehension ^.trategy to nath test 
problems. This simple instructional program yielded substantial gains and 
indicated that visualizing verbal infornation and learning to tease out the 
message are essential elements in the comprehensicn process. Short (chapter 7) 
Suggested that the regular students were not as intellectually challenged as 
were the gifted students. We feel that all students should be given this 
challenge because students have unique experiences whichi nay cause them to nake 
the problems easier in a wide variety of ways. In addition students like to 
work together and nay come up with even better strategies through sharing ideas. 
This study suggests that students can help design and moctel instructional 
materials and chat teachers need to be concerned with comprehension in all 
subject areas. 

Taylor (1982) explored instructional strategies that usee the structure of 
expository health texts to increase reading comprehensicn. Taylor aught 
students to read and develop a skeleton outline that would represent the 
structure of the text. Every subsection and paragraph was represented by a 
heading or mam idea statement. Onoe the skeleton outlines matched the text/ 
sumrraries were written from them and students discussed the text and their 
sumnaries in class. Students participating in these activities learned to talk 
atx>ut the structure of the text and use it ir fashioning their cwn summaries. 
This instructional program increased memory tor text and sensitivity to the 
structure of expository texts. 

Graves/ Cooke and LaBerge (1983) increased memory for text through 
instruction with story previews ^rior to reading. The researchers found that 
lev ability junior high students using previews responded significantly better 
to short answer questions than students not receiving them. Unlike the typical 
trrief story previews ooimonly given before reading, these were more substantial 
and functia:'ed as extensive irotivational devices. The authors describe them as 
follows: 

Each preview began with a series of short questions and statements 
designed to catch the students' interest/ provide a link between a 
familiar topic and* the topic of the story/ and encourage active 
involvement in a brief class discussion related to the theme and 
topics of the story. This was followed by a synopsis of the story. 
The setting was described/ the characters were introduced/ the point 
of view was specified/ and the plot was described up to the point of 
the clinax. Next/ the characters' names were repeated along with a 
brief statement identifying eadi of them. Finally/ three or four 
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difficult words were briefly defined, Eadi preview was about 600 
words long, (p. 266) 

Students receiving previews recalled slightly nore than twice as much 
infornaticn as students who sinply read the short stories. 

Rather than provide previews, Geva (1983) had learners construct flow 
charts to represent content and structure. Students studied the function of 
various structures^ called IUF*s (Text Unit Functions) and provided instruction 
in seeing text in terms of content and relations among conponents. These 
relations included statements of topic, elaboration/ cause-effect, process/ 
exarrple, detail, and conclusion. The flow charting strategy led to more careful 
reading of expository texts and was more effective fee less skilled readers. 

Text production was the other focus of the text structure research. 
Winograd (1963) and Hare L Borchardt (1983) looked at instruction in sunmarizing 
as a way of increasing reading conprehension. Winograd (1983) reasoned that 
sensitivity to importance amcxig ideas in text related to ability to conprehend. 
Instruction focused on learning to identify important elements of a text and 
transform the meaning of a full text into" its gist. When students rated the 
relative iiiportance of each text sentence, differences between good and poor 
readers were evident; poor readers were less able to choose inportant elements 
cf the text, often choosing, instead, elements that were novel or of particular 
personal interest. Poor readers were hindered by their lack of sensitivity to 
inportant elements. This factor was found to account for a considerable part of 
the difficulties in conprehension that were experienced by poor readers. Hare 
and Borchardt (1983) conpared inductive and deductive instruction in 
su-nrarization. Students were taught a series of specific sunnarization rules - 
to get rid of detail/ collapse lists# etc. or to identify topic sentences in 
order to produce sunrories. While neither approach was superior to the other, 
both increased students 's ability to produce sunnBries. 

It appears that there are many interesting things which teachers and 
students can do with text to make it more coirprehensible. For exanple, they can 
alter it through diagrams, re-ordering, and leaving out extraneous information. 
They can also generate outlines, flowcharts, previews and suimaries. Most of 
the text structure studies provide learners with st^s for creating previews* 
summariesi etc. We feel that through reading/ writing and using other 
conntuni cation systems in social situations, teachers and students can generate 
nany interesting ways for rroking text more conprehensible. 



Capsule of Potential Activities 



It appears that there are nany alternate approadies to the use of traditional 
passage questions for reading conprehension instruction. There are also many 
different variations o£ activities. We feel that the best variations encourage 
students to generate their own thinking through engaging in social transactions 
which involve problem solving. We hope the reflections which you have begun to 
noke will help you and your students to use images, illustrations, netaphors/ 
analogies/ drana, TV/ diagrams/ cloze reading strategies/ flowcharts, previews/ 
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suniTBries and other communication systems to enhance undel^standing. 

Because knowledge, which learners already possess thrpugh prior 
experiences/ is a valuable resource for any activity, the final section of this 
paper will deal with this aspect of oonprehension. 



ENCOURAGE STUDENTS TO USE PRIOR EXPERIENCES 



Since iTOst of the studies alrea^jy presented encourage stuctents to use prior 
experiences and Heine (chapter 3) deals extensively with background knowledge, 
we .vill deal with but an example of the many studies which enphasize such 
resources of the reader. We will suggest the potential use of: (1) prior 
knowledge: (2) inference awareness; and (3) knowledge sharing. Studies which 
will be discussed in this section are summarized as follows: 

Table 4 
Exemplary Studies 

Author Prior Knowledge & Inferencing 



Gagne & Meitory 
(1978) 



Hayes and Tiemey 
(1982) 

Marr and Gormley 
(1982) 

Langer 
(1982) 

Gordon 

Carr, Dewitz & 
Patberg (1983) 



Imaging instructions, providing 
background anfcriT^tion,and 
citing familiar examples 

Analogies activate prior knowledge 



Analogies to understand 
unfamilar text 

Prior knowledge assessed and used 
for instructional purposes 

Inference awareness training 

Structured overview, modified cloze, 
and checklist for inferential reading 



Hansen (1981) 



Weaving metaphor for inferencing 



Prior Knowledge 



The first study which we will report on could have just as easily fit in the 
first section of this paper because Gagne and Memory (1978) tested the 
effectiveness of traditional prereading instructional techniques, conparing one 
against another for their effect on overall conprehension. Hcwever, we chose to 
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put it here because the results focus on prior knowlec3ge. 

Gagne and Meirory (1978) looked at five standard prereading af^roaches: (1) 
asking mam idea questions before reading; (2) providing background knowledge: 
(3) instructing students to inage as they read; (4) providing familiar exanples: 
and (5) asking factual and application level prereading questions. The three 
approaches which were significantly more effective than others in enhancing 
overall conprehension were: (1) imaging instructions; (2) providing background 
mfocnation and (3) citing familiar exanples. These approaches each, encouraged 
learners to relate what they already knew to new infornaticn in the text that 
they were reading. In contrast/ less eifective practices (factual/ main idea/ 
and application level questions) focused the reader *s attention on the text as 
the nain source of information. Factual questions led stu(^nts to read for 
factual infornBtioO/ and main idea questions did not improve overall 
conprehension, 

Hayes & Tierney (1982) support the above findings. Through exposing 
learners to familiar and unfamiliar topics and measuring resulting 
comprehension/ they found that prior knowledge is the major determinant of 
learning from text. Their data provided strong support for the activitation of 
general prior knowledge and modest support for the activation of specific 
knowledge related to a specific topic in text, 

Marr & Gormley (1982) add further support for the use of prior knowledge. 
They suggest that prior knowledge is the strongest predictor of student ability 
to draw inferences and elaborate infornation and the factor which predicts most 
successfully student ability to fill in the informational gaps during reading. 
Readers with extensive prior knowledge of a topic can answer inferential level 
questions and are more apt to use information from their experience in answering 
higher level questions. 

Perhaps an'exanple of research on the effect of prior knowledge will make 
these findings more clear, Marr and Gormley (1982) investigated stuctents* 
ability to corrprehend passages on familiar and unfamiliar topics (familiar - 
baseball/ mosquitO/ apple; unfamiliar - curling, aphid/ and papaya). Prior 
knowledge of each topic was measured with questions posed before reading. 
Students read tne passages/ gave retellings r and answered probe questions. 
Interestingly/ students who knew more about a topic told more about it in the 
course of responding to probes while their retellings stayed close to the text. 
Learners also seemed to use analogies to understand unfamiliar text. What they 
knew about one mentoer of a category helped them grasp another, 

Hayes and Tierney (1982) also found this same effect as they investigated 
how American readers knowing about baseball would understand the game of 
cricket. Critical factors became the stuctents' knowledge of baseball and the 
provision of other instructional texts about either baseball or cricket. 
Students making analogies activated general knowle<^e that subsequently was used 
to understand unfamiliar text. In general/ knowing more about one's world 
enables the reader to understand a range of topics and knowing about specific 
topics strongly influences comprehension of that and related texts. 

The above research supports the value of discussion prior to reading/ but 
leave us with two najor questions: (1) How exactly are teachers to know when 
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otuc3ents ar^* "reacJy" to read an unfamiliar text?/ and (2) Hew are teachers to 
iniorirally assess the amount of prior knowlec^e students bring to bear on any 
given reading experience? 

As Hayes and Teimey have suggected/ for certain purposes it my be more 
fruitful not to assess specific knowledge. The reader's general knowledge my 
be more useful. Then too, readers my want to find out if they would like to 
know m^re by reading about something unfamilar, Heine (chapt r 9) deals with 
this issue/ and to some extent we will deal with it in the final part of this 
section of our paper. 

In relation to question two/ we present Langer's (1982) study in which she 
attempts to assess prior knowledge for instructional purposes. We present this 
study in some detail as there are mny tiroes when teachers will find her Pre 
Reading Plan (PReP) extremely useful, 

Langer's Pre Reading Plcin {FRe?) allows the teacher to determine students' 
prior knowledge about a specific topic, learn hew that inforaiation is organized/ 
learn what language students use to express their knowledge, and decide hew nuch 
additional inform tion needs to be taught before students are ready to learn 
from the text. Essentially PReP is a-prereading discussion centering on an 
essential concept, which proce'is in the following three phases: 

1, Initial Associations with the Concept 

In this first phase the teacher says: "Tell anything that comes to mind when 

(you hear this word, see this picture/ etc,)," As each student freely 
associates and tells what ideas initially came to mind/ the teacher writes 
these responses on the board. During this phase/ students have their first 
opportunity to mke associations between the key concept and what they 
already know, 

2, Reflections on Initial Associations 

During the second phase/ the students are asked/ "What mde you think of 
^,.(the response given by each of the students during phase 1)?" This phase 
encourages students to become aware of the associations they have mde/ to 
listen to each other's responses/ and to become aware of thei changing 
ideas. Through this procedure they gain the insight which permits them to 
evaluate the utility of these ideas in the reading experience. 

3, Refornulation of Knowledge 

After each student has had an opportunity to think and tell about what 
triggeL-ed their ideas/ the teacher asks/ "Based on ewr discussion/ havp you 
any new ideas about, ,, (the word/ the. picture/ etc,)?" This phase allow;3 
students to tell about associations which have been elaborated or changed as 
a result of the discussion. Because they have had a chance to probe their 
memories and evaluate their ideas in tenirts of the text/ tliey will read and 
reformulate their ideas in light of the reading task. The responses 
elicited during phase 3 are often more refined than those elicited during 
phase 1, (p, 154^155) 
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This discussion serves as Loth an assessment and as an instructional 
activity benefiting both teacher and student. It is designed to help the 
teacher understand students' levels of knowledge and mke planning of additional 
experiences easier. It also helps students call to mind their own knowledge and 
anticipate concepts in the forthcoming text. 



Inferencinq 



Prior knowledge is a significant factor determining the quantity of inferences 
produced when students read. Studies cn inferencing indicate that the critical 
factor is the connections learners rrake between their previous experience and 
text. Three studies which explored specific instructional strategies in 
inferencing and their effect on reading comprehension are Gordon (1980), Carr, 
Dewitz Sc Patberg (1983) and Hansen (1981). 

Gordon (1980) conpared a content and structure group with a grougi who 
received inference awareness training. The content and structure group received 
instruction in the content (background knowledge) pertinent to a passage before 
reading. The inference awareness group received instruction as to when and how 
to nake inferences. Additionally, they received lessons describing and 
denonstating the reasoning strategies they needed to engage in to be successful. 

While the inference awareness group was superior on total overall 
comprehension, the content and structucife group was more successful with written 
sumnaries. This study suggests that learners need a variety of strategies, and 
that cornprehension strategies vary as a function of purpose. In view of Short's 
(chapter 7) discussion of Gordon's study, it appears that teachers may want to 
vary the inference awareness instructional procedures so that students can 
reason at higher levels to raise their own questions in coming to better - 
understandings. 

Carr, Dewitz & Patberg (1983) explored two combinations of strategies in 
atteiipting to increase inferential reading conprehension of expository passages. 
One group used a structured overview to activate background knowledge, a 
modified cloze to help integrate that knowledge with text inforraticxi, and a 
self-monitoring checklist to help students monitor their thinking. The overview 
provided a hierarchical view of the reading raterial and provided a structure 
for assimilating new infomation. The cloze strategy was used to model and 
improve mferri.ig and was monitored in the checklist. Questions on the checklist 
focused on whether answers nade sense, fit with prior knowledge, and fit the 
context. 

The second group relied solely on the cloze strategy with the checklist and 
omitted the structured overview. Both combinations produced significantly 
better inferential conprehension than the control group and neither was 
significantly better than the other. The cloze procedure was credited with 
providing students with a strategy for finding the information needed for 
answering inferential questions and the checklist was credited with enabling 
students to use this inferential skill in delayed transfer teste. VJhile Carr et 
al. encourage readers to increase understanding through generating their cwn 
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predictxcns. Short (chapter 7) suggests that one negative effect on critical 
tnmking is the fact that their modified cloze enphasized finding one right 
answer fee the blank. Kcwever/ this can easily be overcocne through using such 
c^ze variations as Barbara suggested in the previous section of this paper. 

Hansen vl981) investigated two instructional strategies using stories from 
Lasal readers as text naterial. In the first, students were given a steady diet 
of inferential questions: ail those included in the teacherVs nanual and all 
tnat oould De rewritten as inferential, Students read the stories and answered 
inferential questions • In jne second treatment, diildren were tau^t to use a 
weaving .iBtaphor for the process of connecting new inforiration trora stories with 
cid inforiration {prior knowledge). Strips of bright colored paper represented 
new infcrneticn aad hypotheses about the story were written on them by learners 
respofiding to teacher questions. Strips of gray paper represented existing 
kncfcwle.'lge and students wrote inportant inf car/nation on their, as teachers asked 
aoout their e^^rience relative to the story. The idea was to deironstrate 
concretely how new and old inforiration are woven together prior to and during 
reading. Learners, in fact, actually did weave thece strips as they continued 
t-ie process cf learning nore about the story using the two kinds of inforiration. 
The results of these strategies were that both were effective in helping 
otJ^3e^.ts draw inferences spontaneously. The weaving group ejqperienced the TOst 
success in answering inferential questions in the classrooni and the question 
orcup was iiost successful on standardized tests. Further discussion of this 
study can be fc :nd in diapter 10 by Snyder. 



Knowledge Sharing 

^roara is wcrKing on expanding the weaving inetaphcr in order to get learners to 
snare nnc^^Iedge ir. social situatior4S to enhance personal understandings* While 
isarbara has not yet had a dianoe to try this idea out with learners, she incites 
you tc examine her current thinking to see if you nay be interested in varying 
and continuing the following procedures: 

1. Students write on a white file card all of the knowledge, experiences* 
and areas of e:qpertise uhich they feel they knew and would like to share 
with others. 

2. Students write on a differen*: color card the kinds cf knowledge/ 
e>perienoes# and areas of expertise that tney are interested in# but feel 
they need to knew more about* 

3. students £or4n themselves into groups of 4-6. 

4. tach group discusses the inforiration on their cards and ways they irdght 
share this infcnration. 

Each c^oup reports on their discussions* 

• The teacher asks t ^e. class to sum up the irajcr f;.nding3 and reflect upon 
tne value cf the experience in whidi they have participated. [Insights into 
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reacJing coirprehension such as the follcwing should surface; (a) the need 
fcr sharing knwledge and experiences: (b) the need for sharing through 
reading/ writing^ arl# nusic# drana, and other ireans of ccirniunicating: and 
(3} the need to be more conscious and reflective of their own learning 
experinces in order to help other learners, 3 

There is no limit to the nunber of interesting experiences which such a 
group cf learners could pursue. It seems that such knowledge sharing should 
result in ver\- worthwhile personal understandings because learners would be 
engaging in probleir, sclving through a variety of oomrunictation systems and 
social transactions, I suggested to Barbara that teachers may find it very 
useful to think about her knowledge sharing idea when reflecting on, (1) the 
questions presented at the end of the 'Amount and Kind of Instruction' secticn 
cf this paper; (2) the social nature of leaxming and sense-making function of 
conprehension discussed in the 'Increase Students Interest and Involvenent* 
section of this paper: as well as (3) the prior knowledge and inferencing 
discussed in this section. 



The studies whid'* we have presented, while not including every inportant trend 
and investigation f present an exanple cf interesting ideas which you may want to 
use in your classrooms. It certainly seems that the focus of comprehension 
instructicn shapes the nature of students' compreh^ding, Caiprehension 
instruction which nakes use of prior knowledge and social-oiltural patterns of 
learners is recoftiDemded. 

l^e feel that this instructicxi will be most effective when learners are 
engaged in social interactions which involved problem solving. Many 
instrt'Cticnal foriiats and strategies which you may want to engage in with 
learners have been presented throughout our paper. Activities using inages, 
illustrations* metaphors, analogies, drana, TV, diagrams, cloze, flcwdiarts, 
previews, and suntraries can be expanded and modified. Such activities need to 
build on students* existing knowledge, provide for extensive discussion, and 
place learners in active social interactions. 

Tne most innovative trends in the research seem to be those which involve 
images/ analogies and metaphors. Such comprehension instruction centers on 
using prior e^riences, context, and moves to a.t, drama, and the like co 
increase reasoning abilities. We would like to suggest that both innovative and 
traditional activities can be vor>' worthwhile when learners ara actively engaged 
in varicos social situations. 



We've decided to bring this paper to a close by discussing what working on it 
has dene fcr both of us. Our brief dialogue nay further aid you in your 
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reflections on cor^/rehensicn instruction which we have been suggesting 
throughout this paper. Below is the gist of our convarsation: 

"Barbara, it seems that you use studies like these exenplary ones to 
help youself generate an overall perspective on conprehensicn 
instruction. You rejected sone ideas, and nodif ied other ideas, and 
you seem to be seardiing for ideas that may be useful in terms of your 
beliefs." 

••You're right, Karen, but the iiajor thing which working on this paper 
has done for is to make me reflective of ny past teadiino- ^ The 
research has demonstrated to me that there are many alternatives to 
end-of-passage cornprehension questions- I can't wait to get bac3c to 
Glooscap Eienentary School to really get the diildren engaged in using 
reading, writing and other activities suggested in these studies to 
enhance their understanding." 

"Speaking of writing, the actual writing and related discussions which 
we two have engaged in seems to support further what you have been 
suggesting about learning be5ng social because I certainly have 
increased my understanding of oonprehension instruction through 
working with you on this paper. I new have mare of a feel for hew 
this research can influence what's currently happening in dassroc^. 

"Kar^n, the fact that I feel the same about our working together even 
further supports the need for such social learning. Through working 
on this paper with you, I've realized more than ever before that I 
need to read, vndte/ discuss and do real life things with ny students 
just as we have cone. It was the actual engaging in our discussions 
and writing that was a very big factor in naking these studies more 
comprehensible to me." 

"It seems that researchers and teachers need to think together about 
such issues as those we have raised in this paper. I hope more^ 
researdiers nake use of the thinking of teachers and what is going on 
in classrooms. Researchers and teachers need to think together." 

"That's very true, Karen. Our thinking together about these studies 
has certainly made me more reflective. I*m getting a clearer notion 
of what I believe are important activities and experiences for 
iiTproving comprehension instructiOT. " 

"Barbara/ I hope other teachers will be as reflective as you whsn they 
read cur paper." 

"Karen, I think our paper will help, but more iirpcrtointly they will 
need to engage in conprehonsiOT activities with students and then 
reflect and shar^ their understanings with researchers." 

We invite you to take Barbara's last oormient sericusly. The experience 
which we have had is too valuable not to share with ethers* If teachers and 
researchers engage in such shared understandings, then not only coiprehonsicn 
instruction, but indeed all instruction will inprove. 
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Chapter 9 



READERS AS EXPLORERS: USING BACKGROUND KNOVLEDGE 



David A. Heine 
Indiana University 

INTRODUCTION; A VISTA 

Children do not come to school enpty vessels ready to be filled 
vith facts and skills. Quite the contrary, children cose carrying a 
wealth of experiences that make up the foundations for what will be 
learned* This wealth of experiences has cose to be referred to as 
background knowledge. This chapter examines current research on reader 
bsckground knowledge as it relates to reading comprehension. 

The current research is very clear that a reader's background 
knowledge is critical to the reading process. No reading event occurs 
without the reader tapping portions of this vast expanse of knowledge. 
Even the decisions that direct what background knowledge is to be 
accessed is dependent on the reader's background knowledge of the 
reading process. Because no two readers have the same personal history, 
no two readers have the same total background of knowledge. This makes 
an instance of reading a unique experience to every reader. If teachers 
and researchers are to better understand readers and reading they must 
consider the contribution a reader's background knowledge makes in 
comprehending text,* 

In the following section I define several types of background 
knowledge through a literacy experience of a preschooler* I then review 
tha current research on each type of background knowledge* Next, I 
argue that future research and pedagogy need to consider a more complex 
conception of background knowledge along with the context in which 
reading takes place. And finally, I consider possible implications and 
suggestions for teachers and researchers* 

MAPPING THE TERRAIN; VHAT IS BACKGROUND KNOWLEDGE? 

To get a notion of what types of background knowledge a reader 
raght bring to a reading event, let's look at a classroom scene where a 
preschooler, Mary, is getting acquainted with her classroom. Although 
by school standards Mary is not yet a reader, not^'ce what she already 
knows about reading. 

Several weeks before Mary's first day of school she 
visited her kindergarten classroom, Mrs, Rossow, the 
kindergarten teacher, invited Maxy to play in the playhouse 
corner of the room while she got acquainted with Mary's 
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uvlh*,'r- In Ihf pl;l\hou^♦.' area Mary :-iirVi"V*-J ih*-- I^^vn, the 
lurruturt- and the tinuks* huun Mary uas hard al uurk. 
Fii>t, .-ho rc!.ru»\j.^d all tb> i^.iuifed anin^ih. Irwr. thf* tuy 
Lux. ^h^ arranged then on luo pillows, Uaning the ariinals 
together for i^upport. N:xt, Mary went to the bookshelf and 
leafed through several books. Finding one that apparently 
ret with her approval, Mary pressed her finger to each 
letter of the title as she recited the names of the 
letters. Mary returned to the play area announcing lo the 
stuffed aninais that she was goirg to read them a story 
about a seal. She told her stuffed animals that seals live 
in the zoo and that she saw some there. As an after thought 
.-he also ventured that she thought some lived in the ocean 
too. Sitting down cross-legged in front of the toys Mary 
opened the cover of the book, leafed through to the first 
page of the story and started *roading\ Mary began with 
"i;nce upon a tir.e," although the text on the first page did 
nut. Like the illustrations, Mary's story included a seal 
and an elephant. Tnlike the illustrations (or the text) 
Mary's storv also included monkeys, giraffes, lions, tigers, 
in d bears. >bry 'read* fluently, interrupting herself only 
occasionally by a giggle or a conunent about her enjoyment of 
this story. As Mary turned from page to page she modified 
the story line in response to selected elenjents within the 
illustrations. In Mary's story animals talked and she used 
different voices to distinguish the characters. On the 
final pa^e of the book Mary 'read' that all the animals were 
safely back in their cages just in time for dinner. 
Specifically attending to the text on the last pa^e Mary 
swept her hand across the words as she read, 'The End.' >5ary 
then closed the book, obviously pleased with her production, 
mi asked the stuffed animals if they had enjoyed the 
storv. After returning the book to the bookshelf, Mary 
kissed each oi the stuffed animals, laid each down on its 
pillow, and she told them to be very quite. Mary tiptoed 
out of th<' playhouse area. 

Allhouj^h Mary had not received any fornal literacy instruction, she 
denonst rated that she knew a great deal about reading. And what she 
alrejdy knew (her background knowledge) wan used in creating this 
reading experien/e. .\»»search on background knowledge und comprehension 
sncgesls tour broad tvpes of background knowledge that readers use. To 
get an unders? indinc nf these typ^^s of background knowledge, we will 
vXjniTit' each i4 then in light nf Miry's reading experience. 

rpnteni Knowled'^e. Knowin;]! abot't the subject being read is crutial 
tA reading comprehension. Thi.^v m be seen in Mirv's choice of a bonk 
about ^eals. She demonstrated th it she rr-<rogni7,ed si als by the book she 
cho.Ne. ^he also relal» d her o^n personal r xpeneno wiih seals and even 
speculated about Uvss certain mforrr.ition when sht- :.tid she thought seal 
also lived in the ocean. She i el led on her prior knowledge about >!oos 
to expand the r.eaning oi her storv hevontl the illustrations iii choosing 
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iiTht r liki'ly, but nni rti'presenled, characti-rjs lur hti :>i*jT\ in?,ludinK 
n<>!}kf\s, >iirani:>, lions, tij^ers, and bears, 

Mructural Knowledge, Texti^ are structurally organized and Mary 
denonsl rated that sh * v/as already familiar with one kind of structure - 
-lory grammar, Mar> knew that her story had to follow a sequence that 
^ould logically conclude at the end of the book, Mary also showed us 
she was aware of tne difference m language structure of a story to 
evt»ryday language through her conventional "Once upon a time,,," and 
u:^e u£ dialog within the story. We know that Mary was also aware that 
books are structured with a title on the cover followed several pages 
later b> the text whici. is partitioned across the remaining pages of the 
buuk. When readers are aware of the structures involved in language and 
print they can better predict what they well encounter* Mary 
demonstrated that she already knew many things about the structure of 
readin?.^. 

Process Knowledge, Reading involves many integrated processes and 
knowledge of those processes is essential to reading comprehension. On 
the broadest scale Mary demonstrated a process in orchests^ating the 
entire reading event from identifying an audience, to selecting a book 
and reading it, to finally putting the stuffed animals to bed. Within 
the story itseli, Mary constructed meaning guided by and responding to 
hoth the graphic mJorniation and to her own background of knowledge and 
expectations. 

Pragmatic Knowledge, Mary knew much about the world and life in 
general and this knowledge was central to the decisions she made, Mary 
took on the personal stance of "mother" with which she seemed to be 
q^jiiv ianiliar. This initial decision set the framework for other 
Itxi^i^^ns, Mary kni-w that mother:- read to their children so she read to 
n',r'>. In sol^ctin^ a text about animal she seemed to take into 
3v count ihv background knowledge *u her andir^nce. In telling her story 
'liry kntw hnw to shift from being the story lelle.^ to being an 
V ab'jTiTAr reactor to the story by interjecting her own coiTimcnts and 
^i^aIiuk* Knuwing about life and about the multiple perspectives we 
t,ike It nn\ ^:lvtn tine shaped 'Gary's reading experience and therefore 
.shaped iirr renJmg comprehension, 

B it k.^round knowledge is not the sole domain of the preschooler. 
\:! h irners brina m beai what is currently known in creating new 
'irJ^ r-nndun^rv, nider Karners, unlike preschoolers, not only have more 
Utv f XivTivmv,-. hut also more formal educational experirnces on which 
draw m cr mprehtndmg text, 

MiryV^ '•i'idtriv: episode de'^om-lrates the type., of background 
i^.nr>wh'd;<*^ available to all readers, Hach of thesi* types of background 
knowi* :i!>:i^ ijue hwu the focus of research, in the next section of this 
4!jtpter uill tak»* a closer l-^iok at the research and the findings that 
addrtjs>» «M» h of these types of background knowledge. 
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HXFLORING BACKbKUUNU KNuWLEDGE 

Background knowledge involves content - information about the 
i?ubject being addressed. ResearchertJ who have explored content 
background knowledge have generally been interested in the link between 
the amount of background knowledge and reading compreheni^ion. 

How does content knowledge affect reading comprehension? Marr and 
Gronley (1^82) had fourth graders read, recall, and answer probe ^ 
questions about texts that were either familiar (baseball, mosquitos, 
and apples) or unfaniliar (curling, aphids, and papaya). They found 
that prior knowledge affected comprehension in three ways. First, 
specific knowledge about a topic supported learning more about that 
topic- Second, knowing about a related or parallel topic seemed to 
affect connprehension in the otherwise unknown topic. And third, general 
knowledge of the world improves comprehension on a specific topic. 

Where do readers get knowledge of content? Ribovich (1979) reminds 
us chat we take a risk if we assume that only formal "schooled" 
knowledge reflects useful prior knowledge for reading comprehension, 
Ribovich asked education students and economics students to read and 
retell from both education and economics texts. Before reading they 
predicted what concepts, ideas, or information were likely to be in the 
text (this was an assessment of background knowledge) and after reading 
they reported unexpected information they had encountered. The results 
irom the economics text were predictable - economics students predicted 
r.ore, remembered more, and listed more unexpected information than the 
education students. On the education text, however, both groups did 
about equally well, with the exception that the education students did 
predict more information than did the economics students. When we 
consider that the economics students have experienced thirteen to 
se\enteen years of education it is reasonable lo assume that they, like 
their education counterparts, have a wealth of background knowledge 
concerning education. 

Does the quality of content knowledge affect reading 
crmprehonsion ' Researchers have also probed the effect of the quality 
nt background knowledge. Holmes iVmi) assessed the* background of 

jdvTs to hv either (1) accurate. (2) inaccurate, (i) incomplete, ^r 
{^) missing, Holmei^ found that good and poor readers with little 
background knowledge comprehended about equally veil, while good readers 
cfinprehended r.ore than poor readers when they both had substantial 
background knowledge. Further, Holmes found that poor readers tended to 
rely on inaccurate background knowledge even when it was incompatiblr* 
with the text, t'tond readers reco^^ni^ed the incompatibility- Upson, 
(1982) like Holmes tound that comprehension is r^nhanrrd by the amouni ^if 
background kn wledge possessed by the mader. Sin- notes that readers 
were-nore likely to recall text infr»rmation thai was unknown to the 
reader than information that was known bul counter to the text. Thesf 
twu studies suggest that although the quantify and quality of barkpround 
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knouledgt* 1^ iTTiport.int tu comprchvnsiun, Ihv way thai knowledge used 
uliin affects a readers cuinprehension. 

Other re^earchers have investigated the qualitative - quantitative 
nature ot background knowledge. Langcr and Nicolich (19B1) used a free 
ai>r5uciat ion technique a^kJlng readers* to respond to several key content 
word^i with "an> thing that comes to mind." The responses were then 
categori;'.ed to reflect one of three levels of prior knowledge, Langer 
and Nicoiich found that the qualitative level of prior knowledge was a 
strong predictor of recall. Hare (1982) using Langer 's technique, 
however, found that a simple quantitative count of acceptable 
associations was a still better predictor than the weighted qualitative 
measure. 

This rei-earch demonstrates the impu -nee of content background 
knowledge. Perhaps more significantly it suggests that the quality of 
the knowledge and how that knowledge is used contributes to reading 
comprehension - 



Structural Knowledge 

Researchers have focused much attention on the knowledge structures 
or schema that readers bring to reading. Whaley (1981) found chat even 
yeung readers can use their sense of story structure to comprehend 
text. Whaley demonstrated that children at the third, sixth, and 
cie%enth grades could read stories that contained substantial blocks of 
nissmg text when the stories were of a familiar structure and the 
mssmg text represented one of Handier and Johnson's (1977) story 
grammar text elements (i.e. setting, initiating event etc.). The 
reader's sense of text structure apparently provides sufficient 
oik. imitation to the story to predict the missing text. Dreher and 
^inger (1980) tried to teach story structure to fifth grade children. 
They prepared wt.rksficets that outlined a story structure. Students were 
**> write m tht* specific events of a story under each element of the 
,-ttjry i^ran^mar. As Uhaley found, the students may have already had tacit 
Knowledge ot the story structure because the training did not improve 
V ^aprehension- 
UheJe IChalev l<^ok*:d for universality across age groups in use of 
-*nole text narrative ^,tructures, Moscnthal (1979) investigated the match 
bi iwven variouiv narrative paragraph structures and the reader*s internal 
niuitixe schtni. Moscnthal identified three possible types of schema 
lor \hv ihei-.e of a paragraph - theme initial schema, theme-final schema, 
and no-theme-.-^tr uf tut?- schema. Readers judged to use one of these three 
-chiTia tvp»'S or no theme schema at all were asked to read narrative 
anagraphs from each of the schema types. Moscnthal reportj>, that as 
pieJicled, leader^ recalled the most when their schtma matched the text 
-?ru(ture, and readers with theme schema recalled more that readers with 
no tht-me ^rhj r.a» 

How do readers handle unfamiliar text structures? Kintsch and 
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urwiiv { 1M7K) ui>vd a iairv lulv and an Apacht- iuik talc /liucluit' to 
t*xplore reader;., use of familiar and unfamiliar text structures. Reader.s 
not familiar vith Apache folk laleb were asked to read both a fairy Xaie 
uilh a familiar structure to the readers and an Apache folk tale. After 
reading they u:?re asked to write summaries immediately following the 
reading and again after varying passages of time. Kintsch and Green 
fuund that the readers wrote better summariei> and coni^ii>tentiy recalled 
a similar text over repeated recalls when they read the familiarly 
structured fairy tale. tVhen rt-ading the Apache folk tale, however, the 
rf-aders introduced increasinyl> severe "diiitur tiuns" uf the plot during 
each of the several repeated retellings. The readers' knowledge of 
structure seemed to aid in both the initial recall and also in 
Djintaining the story across time. 

In what ways do text structures support comprehension and recall? 
Using expository text Taylor (I980j found that good and poor 
comprehL-nders seem to differ in the structure they use in recall. She 
had sixth graders recall a text immediately after reading and again two 
days following the reading of an expository text. While both good and 
puor comprehender^ recalled equi\alent information on the first recall, 
two day.s later the good readers recalled more of the text including more 
top-le%el structures than the poor readers. It appears that more of the 
text wa^ remembered because the good readers had used a text structure 
that aided recall. 

Is text structure only in the readers head? Anderson, Spiro, and 
Anderson (197s) found that the structure within the story can affect the 
rc^.all of t^pecl^^c information' wi thin the text. Readers read one of two 
texts: one illustrated a restaurant schema and the other a supermarket 
schema. An identical list of food items associated with the same 
characters were included in the same order in both stories. When asked 
to name each food item and the character associated with it the reader 
could recall more items and characters from the restaurant text than 
from ihe supermarket schema. nderson ct concluded that the 
reader's familiarity ol the structure of a restaurant meal, from 
appetii^er to dessert, aioed the r<L»call of the text. 

If a reader's knowledge ol text structure is crucial to reading 
comprehension how does a reader without an appropriate structure cope? 
\ ^tudy b> Chi istopherson, Schoult/, and Waern (1981) in part addresses 
thiv ijut«^tion. Readers wt-re asked to read an int<-ntionall v ambiguous 
tvxt original! V used by Johnson (1972) describing the procedure for 
washing clothes. While no information in the text wa^ misleading 
ne ither was thL^r*.- information that confirmed the process being described 
v%as washing rlothcs, Somv readers received a titled copy, Washing 
i'lMthes , which m^ide the text unambiguous while other n-ader^ received an 
untitled copy rif th»- ivxl. Not surprisingly, Chr istopherson et al. 
report that rt iders who knew the tt-xt was about washing clothes recalled 
moro of !:hi- text tht n readers that did not, llw readers that were able 
to u::.e thrir knowledge of laundry were able to monitor the text less 
fn^quently than readers that didn't have background knowledge* ll is 
interesting to note that the readers wil^hnut a "laundr\" schema looked 
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like metiicient readers. Chr it^tophorson concludes: 

The findings to date suggest that some students who 
have problems understanding and recalling text may not have 
deficiencies in their listening and reading skills; their 
difficulties in comprehension and recall may be attributable 
to the unavailability of relevant prior knowledge, either 
because the information is not known or because its 
relevance is not perceived. 

Do readers intuitively pick up knowledge of text structures or are 
they explicitly taught? There is research to support both positions. 
McGee (1932) compared good and poor fifth graders reading expository 
text. She found that there was no significant difference between each 
of the groups when subordinate idea units were tallied. However, both 
good and poor fifth grade readers recalled more superordinate ideas than 
did the third grade readers. The researcher speculates that this may be 
explained by the increase in the number of expository texts encountered 
in school above the third grade. 

Stevens (1982) found that teaching a lesson on the general topic of 
expui^itory text improved the comprehension of that text even though 
no information from the text was taught during the lesson. Stevens 
presented a high school class with a lecture on the battle of the Alamo 
followed a day later bv a text on the same subject. Information from 
the lecture was not present xn the text yet the students who received 
the lectuic out performed a no-lecture control group on a comprehension 
test. Apparently, the prelesson established a structure which enabled 
the readers to incorporate the new information into their background 
knowledge more effectively than readers without the prelesson. 

t^raves, Cooke, and Laberge (1983) provided below grade level 
reader ^ with written previews which were designed to motivate the reader 
and to introduce the stories and characters. The previews described the 
plot up to the point of climax. Graves et al. found that the readers 
who received previews recalled more and scored higher on both 
inferential and factual comprehension questions. The preview readers 
also reported liking the previews and finding them useful. 

Carr, Dcwit/., and Patberg (1983) provided readers with structured 
ovcrviewv^ befoie reading a text. They found that below average readers 
p(Lif<:*rmed mui.h muitf like the average and above average readers when they 
used the overview as a prereading device. The researchers conclude that 
the disproportionate benefit to the below average readers suggests that 
the above average readers may already intuitively bo using a similar 
or Kan i /a t i ona 1 s t r uc t ur e • 



Process Knowledj;^e 

Researchers have also viewed background knowledj^o as knowledge of 
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the processes usvd to coniprehtMid texts. Kxplorat ion uf these pruces.se.s 
provides insi^hl.s into huw readei ^ comprehend lext ,uid suggetils teaching 
strategies. 

How does a reader's knowledge of language aid reading 
comprehension? The use of the semantic and syntactic systems of 
language have been the focus of several studies, Isakson and Miller 
(1976) observed readers reading altered sentences that were 
intentionally written to be semantically and/or syntactically 
unacceptable' (did not make possible sentences in English), They found 
that good readers tried to correct the violated text as thev read while 
the poor readers read closer to a verbatim text- The researchers 
conclude that the good readers were guided by their internal knowledge 
of the syntactic and semantic systems of language. 

What happens when readers read "unviolated" texts? Beebe (1980) 
using a modified miscue analysit> (Goodman and Burke, 197^») observed that 
a reader's substitution miscues vary in syntactic and semantic 
acceptability. Readers that comprehended the text tended to make 
substitutions that were both syntactically and semantically within the 
text. Poor comprehenders seemed not to>use these systems thereby 
producing more substitution miscues t]^t were semantically and/or 
syntactically unacceptable. 

Does this suggest that poor readers lack knowledge of language or 
that they are not using the knowledge they possess? Cioffi (1982) asked 
readers to mark where it would "make sense to pause while reading 
orally." C'lotfi found that good comprehenders identified more pause 
locations than did readers skilled in decoding. However, when he 
examined the range of grammatical structures recognized by each group he 
found that, "Skilled decoders and good comprehenders exhibited 
sensitivity to the same rage of grammatical structures: (page 90). While 
Cioffi's findings demonstrate that good comprehenders may make better 
use of syntax it does not support the teaching of syntax directly since 
both groups showed an understandirs of the same grammatical structures. 
The difference seems to be that good comprehenders made better use of 
the grammatical information available to them. 

It good and poor readers have about the same background knowledge 
of language do they differ in their knowledge of reading strategies? 
Researchers have used reader introspection to explore the strategies 
readers bring to reading. Olshavsky (1976) asked high school readers to 
read a short text and to stop and introspect about what they were doing 
and thinking each lime they encountered a red dot in the text. 
Olshavsky categorized these protocols by linguistic unit (i.e. word, 
cLiuse, or story), and by the process employed. She found that good and 
poor readers used nearly' the same strategies; however, poor readers used 
them less frequently and less flexibly. Hare (1979) also used 
introspection to explore reader strategies. She had good and poor 
readers read both familiar and unfamiliar texts. The students were? 
asked to write down everything they noticed about their reading once 
they finished the text. Like Olshavsky, Hare found that good readers 
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repuiled usm^ mure strategies than did the puor readers. Sh(» also 
tound that as the text became more difficult for both the good and poor 
readers they all reported using fewer strategies. This suggests that if 
a good reader is given difficult text s/he will use strategies not 
unlike a poor reader. 

Do readers use nonlmguistic strategies such as imagery in reading 
texts? In interviews with fifth grade children Finch (1982) found that 
901 of the above average readers, and 65% of the below below average 
readers reported spontaneously using mental imagery during reading 
without ever receiving specific training. To see if this strategy could 
improve reading comprehension Finch had readers "form pictures in their 
heads" as a way of remembering what they had read. The results were 
disappointing; although small gains were reported, the strategy did not 
favor poor or good readers, nor was it more useful in comprehending 
either familiar or unfamiliar texts. While the gain in comprehension 
was negligible, the fact that so many readers used imagery is 
interesting and may in part explain why the training had so little 
affect. 

Levin et al. (1974) also f^xplored the reader's use of imagery. 
They initially tested readers to see if they learned relatively better 
from pictures or words. Readers who were judged to learn well by 
pictures (whether or not if they learned well from words) scored higher 
on a test ot comprehension than did readers who were not instructed to 
ut»e ima^^ery. Readers that were judged not to learn well from pictures 
(and they generally did not learn well from words either) actually 
comprehended less than an equivalent group that did not receive 
instructions. It appears that prescribed use of a specific strategy 
Caused readers to become less flexible as readers. 

UiU comprehenMon improve if readers ask themselves questions 
before they read? Several researchers have explored the direct 
instruction of questioning strategies. Adams et al. trained fifth grade 
students to recite and apply a modified SQ3R strategy to studying a 
social studies text. The researchers trained the readers to: 



1. Preview the passage by reading the headings and 
subheadings. 

2. Recite the subheading. 

3. Ask yourself questions about what might be important 
to learn. 

4. Read to find the important details. 

5. Reread the subheadings. Recite important details. 
(These first 5 steps are repeated for each subheading 
in the text.) 

h. Rehearse after completing the text. 

Students who were trained in this strategy spent approximately 
twice as much time studying the texts as did the traditional classroom 
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Ihal h*5S than half of the nmlh grade readers trusted used this 
"^triKtuie strategy." Thobe LhaL used Lhe btraLcgy were tor the most 
part readers with high comprehensioiu Specifically teaching the 
signaling strategy was found to aid only those stuo'*nis who were rated 
high in basic reading skills yet low in comprehension. The effects of 
signaling, however, were not lasting. After two weeks those who 
benefited trom the instruction recalled no more information than the 
equivalent groun that read texts without signals. 

Is there a comprehension strategy that combines imagery with 
structure? Smith and Standal (1981) taught college aged readers to use 
a mapping strategy to visualize a structure of a text. Readers were 
taught to represent salient parts of ^ho text in a visual map. 
Interconnecting lines mapped the relationships among the parts of the 
text. Readers who received the mapping strategy training scored no 
higher on a comprehension test than did a control group. It could have 
been that the mapping strategy was too general or simplistic for the 
college aged readers who used the strategy. A better fit between 
strategy and reader might have been made with younger readers. Geva 
( l%3) reported success with a far more complex flowcharting strategy 
iv.iich suggests once again that if readers alieady have the strategy or 
hn equivalent strategy they do not benefit from instruction. Dahl 
discusses Geva in chapter y. 

Can reading strategies be taught? It is clear from the research 
that reading strategies are learned, but whether or not direct 
instruction ot strategies promotes the learning of reading strategies is 
not so clear. It must be remembered that many strategies represent 
tacit knowledge and may already be known and used by the reader although 
s/he may not be able to explain it. We must also keep in mind that 
knowing how to use a reading strategy in no way guarantees that the 
reader knows when it's appropriate to use that strategy. 



Pragmatic Knowledge 

Reading comprehension may be studied as if it exists in isolation; 
bill m tact, every reading event takes place in an environment, within a 
given time period, and for some purpose. A reader's knowledge of the 
constraints, potentials, options, expectations and procedures relevant 
to the task at hand is pragmatic knowledge that will affect what is 
comprehended and how well it is comprehended. 

Do the teacher's beliefs about learning and reading affect reading 
comprehension? To the degree that a teachers beliefs are reflected in 
how reading is taught, comprehension may very well be affected* 
Mosenthal (19H3) suggests that teacher's theoretical orientation may 
atfect the reader's reliance on prior knowledge. He found that teaJiCxS 
who relied on a .ungle text and looked for "correct" responses elicited 
responses from the readers that reflected the current text. Teachers 
who encouraged thinking processes in the discussion of texts generated 
responses from the readers that not only made use of information from 
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the current text but also from other texts and from prior knowledge as 
well. 

Do the student's beliefs affect reading comprenension? Readers do 
have insights into factors that affect recall. Hare (see page 9:8) 
asked readers to predict before reading a tex^ how much uf it they would 
be able to remember and why they would be able to remember that amount. 
One might expect that the readers would have related how much they 
already knew aiout the topic to how much they anticipated remembering. 
This was not the case. Not one of Hare's sixth-grade readers mentioned 
background knowledge as either an enabling or a hindering factor. These 
readers rated themselves as readers and/or commented on the length or 
the anticipated difficulty of the text as factors that would influence 
their recall. This does not, of course, preclude background knowledge 
as a possible factor in the quality of recall. What it does tell us is 
that these readers have a sense of what is required of them and the text 
in order to comprehend. A reader's beliefs about the reading process 
will in part determine where attention will be focused and what 
strategies will be employed during reading. 

Does a reader's cultural knowledge affect comprehension? Lipson 
(1983) compared the comprehension of Catholic and Jewish students 
reading a Bar Mitzvah passage and a First Communion Passage. Not 
surprisingly, she found that readers comprehended more from the within 
their culture text than from the outside their culture text. Lipson 
also notes that when readers read texts outside of their culture they 
tend to apply existing familiar schemata to that text and this then 
"distorts" the text and decreases comprehension. While Marr and Gromley 
(see page 9:A) noted a similar strategy in readers they saw it as an 
assist to comprehension rather than viewing this phenomenon as a 
"distortion". When appropriate schemata are not available some readers 
reason and comprehend by analogy. 

Reynolds et al. (1982) also was interested in the reader's cultural 
perspective. The researchers had black and white students each read a 
passage on "playing the dozens," which is a form of recreational verbal 
insults found primarily in black communities. In this episode the 
principal, thinking things were out of control, stepped in to quiet the 
situation. Reynolds et al. found that the reader's perspective 
reflected the reader's cultural background. Blacks perceived the 
incident in the text as "just laughing and joking around", and whites 
views viewed it as a "riot" or a "fight." Which perspective is "right" 
is a culturally biased question. When the culture of the author is 
unfamiliar to the reader that reader finds the best fitting schema on 
which to build meaning. 

Can a reader's perspective actuary change the meaning of a text? 
Anderson et al. (1977) constructed ambiguous texts which were read by 
either music students or athletes. One of the texts was written so that 
it could be interpreted as being a group of friends coming together to 
play cards, or as being a rehearsal session of a woodwind ensemble. In 
almost all instances the readers comprehension reflected one and only 
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ont perspective throughout the text and this perspective vas greatly 
influenced by tbi-^'T^aae^^c curse of :5tudj\ Athletes, vith few 
exceptions, vievTed the ambi^i^us Card Gaa:e/Musii. passage as a card ganie 



If readers "take on" an assigned perspective vail their 
con;prehension be affected? Pusher t and Anderson (1977) assigned readers 
to one of three perspectives; a hor.ebuyer, a burglar, or no assigned 
perspectixe. The readers then read and recalled a story about tvo boys 
who played hooky and spent the day in the home of one of the boys. The 
researchers found that perspective did influence what was judged as 
important in the story and what would later be recalled • Goetz et al. 
wanted to see if readers with a natural perspective would recall from 
that perspectixe or fron an assigned perspective. They assigned police, 
realtors, and education students to either the burglar or homebuyer 
perspective using the same passage as Pichert and Anderson used. They 
found that readers took ©ore tine reading the portions of the text that 
Here inportant to their assigned perspective, and recalled more 
inforniation that vas important to those perspectives than from their 
naturally occurring occupational perspectives. 

Pragmatics of reading comprehension is by in large uncharted 
territory. In the next section we will survey pragmatics in action and 
recor-xended a new course for research and instruction. 



What does this body of research tell us abo^Jt readers and their use 
of background knowledge? The research demonstrates the inportance of 
considering background knowledge in both research and instruction. It 
falls short, however, in assessing its full impact on reading 
cor.prehension . In this section ve will consider these concerns and 
discuss the issues they raise. 



Contributions of the Current Research on 
Eackj^round Knovledcte 

The research on background knowledge has contributed much to the 
understanding of reading and reading coriprehension. In particular, this 
tcdy of rest-arch: 

!• ?cnon^trales l\.v necessity of background knowledge to reading 
coTrprehension. Tf^ere is no disagrecr.cnt thrjl content knowledge 
(Langer, l^t*l; and Lipson, 1^S2), perspectives (Anderson ct al,, 
1977), structures of language (Isaksoa et al, 1976; tmd Cioffi, 
l^^2), and structures of textr, (Meyer, I9t0) all affect reading 
con prehension* The only debate here triifeht be to what extent 
background knowledge affects conprehension. 



while cusic student 
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2. Demonstrates that the Ui^e batk^^ruuml knuv^lc-d^^e in *.oT::prehundiuu 
text castr tht* reader as an active sleeker t»i manini', r ithei ihin a 
passive recipient of it. Insights from this research chiih-nge 
the theoretical perspective of information transfer which does not 
rely on background knowledge and assumes readers acquire 'the 
meaning' of text, from text, through the application of a set uf 
skills (see Harste, chapter 12) • Contrary to the inforination 
transfer perspective the current research on background knowledge 
suggests that comprehension, in part, is a result of the 
interaction between specific types of prior knowledge and the 
text. 

While these research findings firmly establish a relationship 
between background knowledge and reading comprehension nuch has been 
left unexamined. It is dv belief that the current research does not go 
far enough, individually or collectively, in explaining the complex 
processes employed by readers in utilising background knowledge in the 
comprehension of text. 



Background Knowledge in Practice 

The contributions and the shortcomings of the current research on 
background knowledge can be derrion^.trated through the following vignette 
which is intended to highlight both the charted and the uncharted 
territory of background knowledge. As you read this episode, consider 
the types of background knowledge required of Amanda and what types of 
background knowledge she actually uses to complete her task. 

Amanda w,:is upset. She knew she was a very good sixth 
grade student, and yet whenever she read from her social 
studies text she felt dumb. She had read the chapter on 
ancient Egypt carefully - sounding out unrecognized words, 
using the dictionary to find the meaning of several of them, 
intentionally slowing her reading rate to a crawl - and yet 
she was unable to answer any of the comprehension questions 
at the end of the chapter. In frustration Amanda returned 
to the beginning of the chapter and began rereading. She 
paused m the first paragraph to underline what looked like 
a topic sentence of that paragraph. Amanda continued, 
paragraph by paragraph, underlining topic s»n?enres. After 
a page and a fialf of underlining she abandoned this Kirategy 
to skin the text tor key words found m the questions. I'pon 
finding a key word irrim the first question Anmda copied the 
sentence containing the word and labeled it nunl»-r une. 
Eich of the reTiaining questions vt-re answer* d in a similar 
manner. Amanda had just completed the final qiiesUon as h^r 
teacher collected the pap»-rs. 

In this episode ve s<*e Amanda working ihrou^jf* i social Htudi^-s 
assignment. The decisions she made .e. she nej^of ia!rd this le: snn wen 
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bashed on iho knovlod^c she brought to the learnin>* ov<-nt, UV will 
vxammc the decit;ions she made in lij^ht ol the research previou^Uy 
reported. Uhile the research *»n background knowledge iaforms us about 
sesne ot Aniinda^s decisions, we will also have to look beyond the 
research tor other insights. 

How does the current research relate to Amanda's 
use of background knowledge? 

Content Knowledge. From the j>trategies> Amanda used to complete her 
assignment we ha\e no evidence to suggest that she has background 
knowledge on ancient Egypt. Kor is> there evidence that she, as Marr and 
Gromiey (1^82) observed in their subjects, utilised a parallel or 
related topic to support her learning about ancient Egypt, Whether 
Arianda had background knowledge on Egypt or a related topic and chose 
not to use it or whether she had no background knowledge available to 
her can not be ans'-ered from the current research on background 
knowledge. Most of this research looks at the relationship of the 
quantity or quality of content knowledge to reading comprehension 
(Holr.es', 19b2)). To gam insights into Amanda's decisions to use or not 
use potentially available content knowledge requires the research to 
look beyond content knowledge itself to the constraints and 
opportunities currently available to Anianda within her present 
situational context. 

Structural Knowledge. Ve can see from this example that Amanda 
expected textt^ to be structured and that she assumed she could use those 
structures in cc-mpleting the assignment. She demonstrated her 
understanding that paragr.-^phs are structurally organized by seeking out 
and underlining what appeared tu be topic sentences. She apparently 
anticipated that attending to this organization would support 
ccnprehension of the text. This assumption has been addressed and 
supported by research (Taylor, 1982; and Mosenthal, 1979). 

In her change of strategy we see that Amanda expects this text to 
W' senanticaily Arg:int2ed so that if she locate^ a term within the text 
she has also located that portion of the text that deals with that 
tern. In a crude :^cnse Arnanda is assuming an overall text structure in 
applying this parlirular ::>irategy. From Amanda's decision and the 
r»n'iew of rescarih, wt* can see I hat both student and researcher 
uxo^nxze the value of text structure to reading (Meyer et al., 19S0), 

nihir thjn l^.>r An-inda's svarth strategy she shows no evidence of 
c nsideting a macro ^.tructure in thjs text. From this single lesson we 
nyj^hx he Tonptr^i to conclude that Amanda knows little of the structure 
*A text, T<» lurp t., thii- conclusion would be to assun:e that Amanda vas 
trvmb^ In UN>* nacro,^tru» tures in her reading but tailed. Ke do not know 
whether A*r.and 4 larked the experience to utilise the sfrurture of the 
text eftectiv* ly ot if she intentionally chose fri>m other more 
it tract ivf options, Whal w** do know is if we want !f» know about 
A'-andi'.s us»* ol tt xi structures we would have tn ob:^* rvc* her in other 
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sessions and have her reflect on her decisions. 

Process Knowleds^e> In completing the assignment Amanda employed a 
sequence of strategies which included some fairly conventional reading 
strategies, followed by a structural paragraph strategy (Mosenthal, 
1982), and finally she employed a skimming strategy (Taylor, 1982) • Each 
of these strategies have been addressed in the research on background 
knowledge. 

Amanda's initial reading strategies were fairly typical outcomes of 
reading instruction - sounding out, looking up, and slowing down. 
Olshavsky (1975), and Hare (1978) found that like Amanda, a repertoire 
of strategies exist for readers to use during their reading, 

Amanda tried to apply what she knew about the structure of 
paragraphs to the comprehending of the text. Although this particular 
method of analyzing paragraphs proved not to be useful, Geva (1983) 
demonstrated that other strategies to develop a sense of structure did 
support comprehension. 

Giving up on the first two strategies, Amanda tried yet another 
strategy - locating a single tern within the text. On the surface this 
might look like a totally idiosyncratic strategy. What reader however, 
hasn't locked to the index for the location of a particular subject from 
a key word? Although Amanda skimmed the text rather than used the index 
(assuming there was one) the strategy served the same function as using 
the index. 

The research on background knowledge allows us to describe the 
sequence of the pro*" esses Amanda employed in this task, but the research 
does little to explain the decisions Amanda used in selecting what she 
determined to be appropriate strategies. 

Pragmatic Knowledge. Except for the research on reader perspective, 
pragmatics is a largely uncharted territory. It is by far the least 
represented and undoubtedly the least understood type of background 
knowledge. Pragmatics refers to all the knowledge we posses on how to 
get things done and to live within our immediate environment and 
culture. Every decision we make is in part based on what we know about 
the situation, about our goals, and about probable outcomes of our 
actions - these are decisions based on pragmatic knowledge. 

The research on pragmatics and reading comprehension has been 
concerned solely with perspective - either a reader's personal 
perspective (Anderson et al., 1977; and Pichert ct al., 1977) or the 
reader's cultural perspective (Kintsch et al., Lipson, 1973; and 
Reynolds et al., 1982). Vc can assume from this research that readers, 
like Amanda, view reading tasks through a perspective or perspective^. 
Just what perspective Amanda used is not available to us and therefore 
the effect of her particular stance is also unknown. 

Most of Aranda's decisions during this lesson wore bas»ed on 
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pragmiitic knuvk'd^v th.it in uulstdt* ul the j^cupe of current rc:scurch un 
background knuwiedgi.*. AriandaS knoulfdge ui thu ^:las^^Jum rules, the 
inportance ol schoal in Ananda':-* life, the pc^rcoived relevance of 
ancient Egypt, the knowledge of the task demands (Mosenthal, 1983), her 
understanding of the coni>equeni.efi of careless work, the time allotted 
for the task, her rapport with the teacher, her social position in the 
classroom, her parent's expectations, and more - all play a role in the 
decisions Amanda nade in the course of completing her lesson. To better 
understand reading comprehent,ion we must better understand this 
inportant type of background knowledge. 

Context ui Situation The accessing of background knowledge does not 
occur in a vacuum. The episode of Amanda completing a social studies 
lesson exists within an environment - a specific classroom on a specific 
day at a specific time. This context of situation also played an 
mportani role m th^,* wa\ An>anda used her background knowledge. Current 
research on background knowledge has largely ignored this factor or has 
tried to control it through manipulation. 

Where Ainanda sat in the room, who sat near her, the location of the 
teacher, the subject being studied, the writing style and organization 
of the author of the text, the temperature, . the noise level, the time of 
dav, the time of year, and the materials at hand are but a few of the 
elements within Amanda's immediate environment that directly affected 
the decisions she made and therefore the background knowledge she 
tapped. To appreciate the complexity of Amanda's use of background 
knowledge we also must recognize the complexity of her immediate 
t-nvironment; to ignore or to attempt to control the transaction between 
the context of i>i tuition, and the background knowledge of the reader is 
to distort the very conditions under which background knowledge 
operates. 

In the discus. -inn .^nd rcvu-w of research on background knowledge we 
hive viewed each i>pe ot background knowledge as existing independently 
from one another. Vet i*e can readily see from Amanda's example that all 
the types of background knowledge are available and arc used 
simultaneously withm a context of situation. No single experimental 
treatment, m fact no collection of individual experimental studies on 
types of background knowledge, can illuminate the processes readers 
erploy in orchestrating their barki^round knowledge. If we as 
researchers n^anipulale the process or focus on anything le:r.s than its 
whole or strip it from the context in which it is found, then ve have 
changed the very *'v.*nt we set out to disrovt-r, 

Pvather than explaining Am;jnd*i's behavior bv any single type of 
buki;round knoi^lfdg- or any collection of t\pus of background knowledge, 
there ite .jdvaniage,^ to looking at tht* total context of situation in 
viewing the impact ^'f bart|;:'roiind knowledge. 

First, Anjnda a valuable resource lor informing the* re:searcher 
teacher ab'Ut her reading. Readers as informants cm provide 
irisight>. not iviilahlf' rhrniK'h ohservation or tr-sting such as the 
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uiidt^rlviiig reasons behind the readei's dt^cisions. Fht- iutormiAUl c-in 
reflect upon the entire e^ent and therefore need aul he buund by singlo 
categories ^u^h at» "backgruiind knowledge" within the pruti-i^s uf 
cemprehension- Fui the re-euruhex thei^e datu embed bdckground knowledge 
wtthm the tui^l reading event including the context in which it took 
place. Only in this total context can the contribution uf background 
knowledge be \iewed as an integral part of the reading comprehension 
process. 

Second, viewing background knowledge in a total context of 
situations allows fur the generation of hypothet>es that would not have 
been possible to generate when looking solely at background knowledge, 
m particular when looking at only one type of background knowledge. 
These questions have the potential to better explain the reader's use of 
background knowledge in actual reading events. 

Without a consideration of the context of situation we gained 
little insight into Amanda's decision making processes- VJe don't know 
why she chose the options she did, or even what options were currently 
available to her. In part this problem exists because tl'e current body 
of research has been concerned with investigating the interiors of 
specitically defined type^ of background knowledge and has not addressed 
the interrelationship of these tspv:^ of knowledge or its transaction 
with the context in which it occurs. To get a sense of its full 
contribution to corrprehension it night be advantageous to consider 
background knowledi;e not as distinct typei> of knowledge but rather as a 
unified whjle that exists only within a context of situation. Ve may be 
missing the forest for the trees. 



L-^sues Raided bv thy Studies 

Tliere are several ii^sue^ on hatkuround knr,wl#'dge that nust be 
considered if we are to better understand readers or the readin^^ 
process. 

The fact that readers havt- .md use barkground knuwledge and that 
bacKground knowledge is cv-sential to reading is of course not disputed 
toda\. What is not known, however, is how leaders po about using that 
knowledge, and if our current conceptual construct of background 
knowledge adequately explain.s the process of its use. These are areas 
that nay provide useful information for teacher.^ and rp.scarchcrs. 

The revivw ot tht- rc rarch on background knowledge and the example 
ot Ananda's -MKifu studies assignment generate :^everal issues tliat 
deserve further exploration. 

1. Tan backjjnmnd knowledge neaningtuUv be aadnd ,ks i.^olaird 

subsv^tens <♦! knowledge as most researrhi r:- are tuirently doing? 
More'specif ically, ran <ach type ol knowlcdj.»e be investigated 
wilhttut considering the relationships tielwei*n, and the transaction 
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anong, vach vf the ^^pecific types of background knowledge? 

2. Dooi> the tonttxt oi situaliun affect the reader's access to 
background knowledge' If so, plans for both research and 
instruction must consider the. numerous constraints, potentials and 
expectations inherent in the total context of situation which 
might direct a reader's use of background knowledge. 

3. Do readers merely apply background knowledge to comprehend text or 
does each reading event pose a potential for the discovery of new 
strategies to satisfy current demands? While much of the research 
has looked for the effect of background knowledge on reading 
comprehension, none has looked at the generative potential of 
background knowledge to create new strategies, or new meaning. 

4. Can background knowledge be meaningfully viewed from a single 
point in time (i.e. one lesson, or a single experimental 
treatment) or must it be viewed across contexts and therefore 

across time? 

5. Must pragmatics be simultaneously considered when investigating 
other lypes of background knowledge? 

D. Do good and poor readers differ in their access to or use of 

background knowledge m comprehending text? Current research is 
divided on this issue. While most report differences between 
readers (Taylor, 1982; and McGee, 1982), the differences are often 
attributable to the difficulty of the text lor any particular 
reader. This suggests that "good" and "poor" readers differ 
little when each are confronted with a text that is of equal 
difficulty for them to read (Olshavsky, 1976; and Hare, 1978). 



IMPIICATK^NS FOR THE TEACHERS AND RESEt\RCHERS WITHIN US 

The implications discussed in this chapter are drawn from studies 
with sample populations ranging from middle school to college ago. Some 
studies used hetero:^encous groups, others contrasted good comprchenders 
and poor comprehenders, and there were also studies that used "have" and 
"have not" background knowledge groups. These studies might also be 
categorized as basic and applied research. One might ask with this 
diversity across studies is it appiopriate to pose implications? I 
think so, provided understand tha» research is but one perspective on 
knowing. Theory and practice both represent other avail^^ble 
perspectives. Fi^^ure 1 presents a model of knowing. It is intended to 
remind the teacher and researcher that knowing requires multiple 
perspectives and that these perspertives transact to allow for new 
understanding's. 
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Figure 1 
Perspectives on Knowing 



Theory Research 




Practice 



Burke 1984 



In the course of our professional involvements we assume a number 
of perspectives. While we may generally identify with one perspective, 
each perspective or stance we employ allows us to see, to know, in a 
different way* 

Teachers are educational practitioners as they plan and direct 
instruction. While teachers may generally take this stance they are 
also educational researchers whei they formally or informally seek^ 
answers to the many problems and anomalies they encounter in a typical 
school day. And simultaneously, teachers are educational theoreticians 
in that each of these decisions is predicated on models of learning, 
cognition and language. 

Educational researchers undoubtedly identify with a researcher 
perspective when conducting formal research, but like teachers they are 
also practitioners and theoreticians - practitioners when concerned with 
research procedure for their subjects and applications for teachers, and 
theoreticians when they build their research design on theories of 
learning and cognition and when generating their own theories. 

These implications are intended to provide yet another perspective 
for the researcher^ the theoretician, and the practitioner in each of 
us. 

Implications for Teacher/Researchers and Researchi»rs 

1, Research should account for the context of .situation. 

Understanding that the context in which reading takes place 
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atletrts what is compruhended provides both probJeras and 
opporiunil leN tor teacher /researchers and researchers. The 
teacher/researcher is ideally suited for research that con^iiders 
children's pragmatic knowledge and the context of reading. It is 
the teacher that plays a ma Jor role in establishing the 
environment, it is the teacher that knows the children across 
contexts, and it is the teacher that has a sense of what 
background knowledge children bring to the reading task. These 
valuable insights are needed if we are to understand reading 
comprehension. The outside researcher must come to know and 
consider the affect that context of situation plays in the 
decisions a reader's makes. This can not be adequately done by 
putting readers in unfamiliar situations or by a single visit to a 
classroom. Getting to know the students and the rules under which 
they operate should be baseline data for any reading research and 
"findings" should reflect the context in which thoy were "found", 

2, Research must take into account how the reader views the research 
task- The perspective taken by the reader is based on pragmatics 
and will affect the reader's decisions related to the purpose, the 
intent, the process, and the importance of the task. If we want 
to know what readers are thinking there is no better way to begin 
than to ask them. Interviewing along with "kid watching" should 
be standard procedures of the researcher. 

3. Research should reflect the transaction among types of background 
knowledge and the environment in which the research takes place. 
While we can intellectually think about "types" of background 
knowledge they only individually exist as an abstraction. The 
resources on which the reader draws respect no arbitrary 
categories. 

^. The ••xploration ot types of background knowledge might be more 

fruitful if I v.^earcher.-v examine conditions under which readers use 
various types of knowledge, 

3, While rcjNeat u has begun to describe the strategies readers report 
using from a rr.etacognit ive perspective (Olshavsky, 1976; Hare, 
19S2; Wjnugrad, 198:^; and Chr islopherson et al,, 1981) we do not 
wi Know what proccsse.*^ drive inose decision.s. In exploring these 
processes it night bv useful to get introspective accounts of 
reader d'jcisions across varied contexts. When context is held 
constant, factored out, or ignored we get a false sense of 
simp! icit y, 

A belter understanding ot pragmatics is needed in research on 
background knov^ledge. Pragmatics has been largely overlooked by 
research, whilr* content knowledge, text structures, and more 
recently pr *ne-»s knowledge* have dominated fhf study of background 
knowledge. Studying readers where they read, using what they 
read, tor the purposes that tliey generally road would tap the 
largely unexplored tt-rrittirv of pragmatirjs. 
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Implications for Instruction 

!• The overwhelming finding from this research is that background 
knowledge improves reading comprehension (Langer, 1981; Lipson, 
1982; and Ribovich, 1979). 

- Teachers may find it useful to build general background 
knowledge. This could be done by; providing time and 
materials for a wide variety of independent reading, 
discussing current events from television and newspapers, 
providing time and means for children to share their 
interests and talents, enriching the classroom environment 
through interest and exploration centers. 

2. Teachers can directly provide background knowledge, which, in turn 
may improve reading comprehension of expository texts (Stevens, 
1982). 

- Teachers may find it useful to provide experiences related to 
the text. These experiences should involve as many senses as 
possible in order to build a rich experience base. 

3. Accessing reader's existing background knowledge improves reading 
comprehension. 

- Teachers may find it useful to provide activities related to 
accessing topics before students read about them. These 
might include; having students establishing purposes for 
reading, discussing the topic, relating unfamiliar topics to 
familiar experiences (Marr et al., 1982), brain storming to 
discover what is collectively known about the topic, 
previewing the text (Graves et al., 1983, and providing 
advanced organizers for difficult texts (Ausubel, 1963). 

A, The direct teaching of comprehension strategies can actually make 
students less flexible readers (Levin et al., 197A; and Balajthy, 
1983) 

- Teachers may find it useful when introducing reading 
strategies to demonstrate alternate approaches and to 
encourage students to suggest still other strategies so that 
the learners understand that there are always mulitple 
options from which to choose. 

5. The context m which reading takes place affects what b<ickground 
knowledge is utilized and what is comprehended. 

- Teaches may want to provide a variety of situntional contexts 
for reading instruction and evaluation. These might include; 
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encouraging letter and note writing, reading to younger 
children, providing a daily free reading lime, sotting up a 
comfortable reading area in the classroom, and providing 
choice in a variety of reading materials and activities. 

The cultural match between the perspective of the child and -of the 
text affects comprehension (Kintsch and Green, 1978; Lipson, 1983; 
and Reynolds et al,, 1982), 

- Teachers may find :t useful to help students handle 
culturally unfamiliar texts. This might include; presenting 
and discussing cross cultural literature including literature 
from other time periods, discussing authors f?nd their 
cultural backgrounds, and relating culturally unfamiliar 
material to culturally familiar ideas. The teacher should 
also recognize that what is culturally familiar to the 
teacher may not be to the students. 

7. Directly teaching story grammar showed little or no affect on 
reading comprehension (Dreher and Singer, 1980; and Whaley, 1981). 

- Teachers may find it useful to capitalize on student's 
intuitive knowledge of story grammar by providing frequent 
opportunities for students to write stories, read stories, 
and to discuss the art and skill of being authors. 

8, Teaching expository text structure strategies improved the 
comprehension of poor readers (Meyer et al., 1980; Carr et al., 
1983; and Geva, 1983). 

- Teachers may find it useful to teach mapping strategies 
(Smith and Standal, 1981) and flowcharting strategies (Geva, 
1983) of both the students background knowledge and the 
expository text. 

Teaching the development of summary statements helped readers 
become sensitive to the macrostructures of texts. 

- Teachers may find it useful to provide experiences in 
developing summary statements from a wide variety of material 
that students can then share, compare, and discuss. 

10. As readers change their perspective, they create different 

understandings of a text (Andt-rson et al., 1977; and Anderson and 
Pichert, 1978). 

- Teachers may find it useful to provide experit}nces that allow 
students to take on alternate perspectives. This might 
include; reader's theater, plays, reading essays, and 
assigning perspectives to students before reading a text or 
rereading a text from a different perspective. 
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11. Good and poor readers demonstrate similar comprehension problems 
under equivalent conditions. These include when they lack 
background knowledge relevant to the text \,Holmes, 1983) and when 
they read texts in which they have not had sufficient prior 
experiences (Hare, 1978). 

- Teachers may find it useful to provide a variety of print 
material related to the subject, and provide activities that 
build background knowledge or that help students access 
existing background knowlj^dge. In evaluation, teachers 
should also consider thejireading material and the purpose for 
reading as contributing factors in reader comprehension 
difficulties. 

12. Good and poor comprehenders do not differ in the reading 
strategies they employ (Cioffi, 1982; and Qlshavsky, 1976). They 
do differ, however, in the degree they rely on specific reading 
strategies. 

- Teachers may find it useful to provide opportunities for 
students to discuss what they do when they read difficult 
text. This will demonstrate to the students that readers 
have multiple options available to them when they read. 



Conclusion 

The research is clear that background knowledge is important to 
reading comprehension. This is a giant step forward from the notion 
that reading uas simply an information transfer process that required 
nothing more of the reader than a rote set of skills. Our current 
challenge is to take that next step in exploring how background 
knowledge fits into the larger picture of the context of situation. For 
the teacher this might include developing strategy lessons that 
encourage the use of multiple t>p(^. of background knowledge accessed in 
multiple ways. And for the researcher this should include investigating 
the decisions readers make in selecting from their reservoir of 
background knowledge. 

To understand reading comprehension we must also understand 
background knowledge and the contexts in which reading takes place. 
Teachers are particularly well suited for this exploration. The day to 
day contact with readers provides valuable oppo^-tunities for teachers to 
observe, to explore, and to recognize the unknown. There is a 
researcher in every teacher. In chapter ten Snyder discusses how to let 
him/her out. 
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TEACHERS AS EXPLORERS: 
TEACHER-RESEARCHERS AND PRESENT RESEARCH NEEDS 

Sharon C, Snyder 
Indiana University 



INTRQDUCJIQN 



Whether teachers engage in research in their roles as teachers 
or whether they invite the collaboration of professional 
researchers, teachers are key figures in the field research 
which many educators now see as crucial to our ability to plan 
for effective teaching in the future. Whenever teachers 
observe their students, evaluating their problems and progress, 
whenever teachers make informed guesses about the needs of 
their students and how to help them mee^ tne demands of the 
curriculum, whenever teachers observe th^ effects of the 
instructional strategies they use, deciding on adaptations and 
then trying them out, whenever teachers engage in any of these 
activities, they are doing lesearch. Teachers are constantly 
engaged in formulating and exploring hypotheses about how to 
irtake their classrooms effective places of learning • 

The students who, for one year of their academic lives, 
cere under a teacher's guidance provide both a challenge and a 
burden, and teachers are keenly aware of their responsibility 
to nurture each one. It is this responsibility to the 
individual child that provides the form of the teacher's 
research question. The teacher is constantly asking, "What 
does ihis fibilfi need to experience in order to learn X?" 

It is the concern for the individual child which often 
distinguishes the teacher-researcher from the professional 
researcher. The professional researcher is most often 
concerned with gaining generalisable insights. Rather than 
asking, "What process does this child need to go through in 
order tc learn X" the professional researcher asks^ "What 
pre cess do Efist fi)lI^JC£D need to go through in order to learn 
Xr"* or "What materials, instruction, etc. facilitate the 
learning of X for most children?" While the professional 
researcher's questions are of interest to the teacher, since 
their answers provide a starting point in dealing with 

particular students, they provide only that a starting 

point. The teacher's research question remains: "How do I 
nurture ihis child?" 

Today, professional researchers are beginning to be 

concerned with the teacher's research question not because 

they have abandoned their interest in the general 
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characteristics of learners, but because they have become 
interested in understanding more deeply the diversity of 
characteristics among learners. This type of research focus 
requires a different research approach. Rather than sampling 
large populations, these researchers focus on in-depth 
descriptions of individual cases or individual classrooms. 
They ask, "How does learning occur for this individual in this 
situation?" 

The value of such research is not only in the 
documentation of diversity among learners; it is valuable as 
well as a test of and as a deeper exploration of 
generalizations suggested by experimental research findings. 
Individual cases provide an in--depth, ground-level view of 
features only grossly perceived at an elevated, generalized 
level. It allows researchers to deal with learning as it is 

known to all teachers as a complex and individualized 

interplay of phenomena. 

There are some practical differences between teachers- 
researchers and professional researchers. Teacher-researchers 
often do not have training in the rigorous data documentation 
and analysis which is required in order for their conclusions 
to be accepted in a public forum such as a journal. Nor do 
teachers as a whole perceive their professional activities as 
including research and publication. Thus teachers' informal 
findings and intimate knowledge about how students learn fail 
to reach the public arena. Professional researchers, on the 
other hand, are often constrained in their research by time, 
funds, and access to ''xeal" classroom situations. The concept 
of long-term research in the field h.as come of age, but the 
factors inhibiting its practice remain strong. 

While research conducted in the schools is on the rise, it 
is still of a short-term nature and often takes the form of 
comparative testing or testing in conjunction with brief 
treatments done out of the context of the normal classroom 
setting. Very few studies involve more than a day's duration 
and even, fewer go beyond a week* This means that classrooms 
and learning as they naturally occur seldom appear in the 
research literature. In recent years, however, some 
researchers have attempted in-depth descriptions of various 
aspects of classrooms and learners in action. 

While more field research is being conducted in some areas 
of educational research, the research on ISSCliDS CiJIDBiebSDSifin 
shows few instances of it. Our study has yielded a number of 
interestina insights about the nature of the research being 
conducted in this area. I would like to share with you our 
preliminary findings regarding the kind of teacher-researcher 
cooperation currently occurring in reading comprehension 
research. This will be done in two ways; 1) by sharing the 
overall trends in the type of research being conducted, and 2) 
by sharing some examples of studies which have been undertaken 
in the classroom with the cooperation of teachers. 
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Reading comprehension as an area of interest for researchers 
has increased over the past decade according to the preliminary 
figures derived from our review of comprehension research. 
(This can be seen from the data presented in Figures 1, 2, and 
3.) This is an encouraging trend when one considers how 
crucial the comprehension of text materials is to all aspects 
of educational life. 

Of special concern here is the type of research which is 
being conducted on reading comprehencion; specifically, "Does 
the research focus on reading comprehension as it occurs in 
action with students in classrooms?" Or, "Does the research 
focus on isolated elements of the reading comprehension 
process?" Research focusing on reading in action would be, for 
example, research in which the investigator observed children 
engaged in their usual classroom reading activities, or in 
which the researcher asked children to read and react orally, 
or in writing or in pictures to stories or expository texts. 
Research which focuses on isolated elements of the reading 
process might, for example, examine children's ability to sound 
out new words while reading aloud; or it might have children 
read short, unrelated passages and then test their ability to 
recall the main idea of each. Of the two general approaches, 
the latter is currently much more often pursued in reading 
comprehension research. 

Figure 1 shows the relative number of these two general 
approaches to research in the field. Studies targeting 
Isolated elements of reading comprehension for investigation 
far outnumber studies investigating reading comprehension in 
action and as it occurs in usual situations. There has been, 
however, a steady interest in reading comprehension research in 
the field, and one might even assert that a slight increase in 
interest is in the wings. 

When it comes to the length of time spent in data 
collection, most researchers acknowledge that the longer the 
examination of a ihenomenon, the better one's understanding of 
it. The length of time spent in data collection, then, is seen 
as important, but it suffers from practical constraints; 
studies are designed to meet budgets and schedules. 
Preliminary data from our study, however, suggest that there is 
a definite trend towa^rd comprehension research of longer 
duration. Still, as shown in Figure 2, the overwhelming number 
of studies undertaken, even in the 1980's when the duration of 
studies increased, remained at less than one week in length* 
There is, it appears, a trend toward longer studies of reading 
comprehension, although this trend has by no means overcome the 
preference of many researchers for very br5ef studies. 
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FIGURE II 

DURATION OF READING COMPREHENSIO.'j STUDIES BY YEAR 
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FIGURE III 



DURATION OF READING COMPREHENSION STUDIES BY TYPE OF STUDY BY YEAR 
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Figure 3 displays the two trends mentioned here, i.e. type 
of study and length of study in combination. Studies of very 
short duration (1 week or less) which focus on isolated 
elements of reading comprehension are by far the most popular 
type of study pursued by researchers. There is a gain, 
however, in the number of studies focusing on isolated 
elements, which involve from two to nine weeks in data 
collection. While there is no preponderance of studies 
focusing on classes and students in action or on lengthy 
studies (10 or more weeks), the slight increases in such 
studies suggest that they are representative of research 
concerns which are currently afloat. 

Studies of longer duration and studies involving 
classrooms and students in action often require resources which 

researchers may not have namely Br.aes^z to classrooms over 

long periods, and time and funds. Such are the constraints 
which operate to curtail the typp of st\idies which many 
researchers may want to undertake. Collaboration between 
teachers and researchers and Lhe initiation of studies by 
teacher-researchers themselves can do much to chip away at 
obstacles such as these. 



STUDIES WITE TE^CB£BrBE5I^B£HiB QQQ2BBhIlQB 



What £aii occur v;hen teachers and researchers cooperate in 
exploring what is involved in reading comprehension? Six 
examples of studies which have been conducted in the field, 
involving the cooperation of teachers and researchers, follow 
here. Two are examples of studies which were short in length 
(1 week or less) and conducted outride the normal classroom, 
but which required students to deal with the kind of materials 
they frequently encounter in their usual classroom situations. 
Two are examples of longer-term studies (10 or more weeks) 
which were conducted in the classroom. Finally, two studies 
are examples of non-experimental, long-term studies which were 
conducted in the classroom. Of special interest in each case 
are three things: 1) the crucial role of teacher cooperation in 
making the research conducted possible, 2) the kinds of 
insights which were possible due to the research being 
conducted within the classroom environment, and 3) the kinds of 
insights which were possible due to the length of time during 
which the data were collected. Each case in an example of a 
study well done; each demonstrates that the quality of the 
insights which are at all possible from any study are as much 
the outcome of the degree of that study's immersion in the 
classroom as they are the outcome of any particular task or 
measure used in the study. 
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This study is an example of the way in which researchers, 
attempting to simul/ite the type of materials and student 
processing which could go on in a typical classroom, can arrive 
at insights which are highly informative to classroom teachers. 
Pressley wantei5 tc know whether children's reading 
comprehension wouid be improved if they were encouraged to make 
mental images of the materials they read. He divided 86 third 
grade children into two groups/ snd instructed one of the 
groups in how to make mental images of their reading material 
and gave them practice in doing so. The other group received 
no instruction. He then tested both groups, asking the 
children in the imagery group to make mental images after each 
page they read, and asking the non-instructed children simply 
to do what the^ needed to do (which may very well have included 
imaging) after reading each page in order to remember the 
information on that page. The test of recall included twenty- 
four short-answer questions about events in the story they 
read. 

What Pressley found was that the children who were 
encouraged to make mental images of the material did, in fact, 
recall more events and details in the story than did the 
children who may have used imaging in part, but were not 
encouraged to do so. His findings seemed to gain even more 
strength when he looked at the time spent on the entire reading 
task by each group; the group using mental imagery took nc 
longer than the group using unspecified recall strategies. The 
implication of this was that the imagery group's greater 
success could not be assigned simply to their spending longer 
in reading and concentrating; their greater recall must have 
had to do with the imagery strategy itself. 

Because this study was conducted with children in a 
reading group very much like the reading groups in many 
classrooms, because it used a story very much like the stories 
children encounter in their school readers, and because the 
imagery strategy is one which could easily be incorporated into 
classroom reading activities, this study is one which is of 
direct interest to educators in the field, i.e. to classroom 
teachers. This study demonstrates as well the type of research 
which teachers themselves could initiate and carry out within 
their own classrooms, independently of professional 
researchers, or in cooperation with them. 
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Cohen and Stover conducted three interrelated experiments in 
order to find out whether math word problems could be made 
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easier for students to understand* In doing this, they did not 
want simply to know how to make word problems more 
comprehensible, but to find out whether students could be 
taught to do this for themselves* As in the Pressley study, 
the researchers conducted these experiments and for the most 
part the children participating as subjects did so outside the 
normal routine of the classroom. However, the study becomes of 
great interest to teachers because the object of the 
reseachers* investigation, i.e. math word problems, is a very 
real part of a child's experience in school* 

The first experiment was designed to discover students* 
perceptions about what makes a math word problem difficult or 
easy to comprehend. Thirty-five gifted sixth arid eighth- 
graders were given math word problems with the instruction that 
they were to rewrite them in order to make them easier to 
understand for classmates having difficulty in math. Cohen and 
Stover then analyzed the kinds of changes they made and arrived 
at a list of twelve types of structural change which students 
thought would improve the comprehensibility of math word 
problems. The types of changes most often made were 
simplifying vocabulary, shortening the sentences, adding a^ 
diagram, removing extraneous information, making the question 
sentence a separate sentence, adding relevant information, 
changing the order of the ;information given, and providing a 
clue. Cohen and Stover also conducted interviews with the 
participating students and found that the students perceived 
that difficulty in solving math word problems \/as mainly a 
question of the verbal presentation of the problem, and not a 
matter of the problem's mathematical relations. 

Through the second experiment, Cohen and Stover wanted to 
find out whether the modifications made by the gifted students 
in the first experiment were in fact effective with average 
students. They chose three of the twelve types of changes 
identified in Experiment I: 1) adding diagrams, 2) removing 
extraneous information, and 3) changing the order of the 
information given so that the problem was set up in the order 
that the elements would need to be arranged in order to process 
the problem. They constructed math problems both with and 
without these three modifications, e.g. five problems were 
constructed with diagrams, and the same five were presented 
without diagrams, and so on for the other two types. 

Average ability students were then given both types of 
math word problems and the results were analyzed. It was 
expected that a 40% difference between simplified and difficult 
word problems would result, i.e. that simplified word problems 
would result in 40% more correct answers than would difficult 
word problems. V7hen diagrams were added to word problems, a 
106% increase in correct answers resulted. When extraneous 
information was removed, a 124% increase in correct answers was 
attained, and when the order of information was changed to 
match the order in which the information needed to be 
processed, the increase in correct number of answers was 80%. 
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The researchers decided to follow up these unusually 
strong effects by seeing whether average students could 
themselves take difficult math word problems and simplify them 
in order to increase their ability to derive correct answers. 
In a third experiment, Cohen and Stover took 71 sixth-graders 
and taught each of them one of the three strategies used in 
Experiment II for making math word problems more 
comprehensible, i.e. 1) drawing a diagram, 2) eliminating 
extraneous information, and 3) putting the information in the 
order necessary for solving the problem. Thus, 24 students 
received instruction in the first strategy, and 24 students 
received instruction in the second strategy, and 23 students 
received instruction in the third strategy. In this way, the 
two groups not receiving instruction for a particular strategy 
served as the control for that strategy. 

Instruction was conducted through programmed materials 
presented in three sessions, each an hour in length. Students 
were instructed to check to see if a problem could be 
diagrammed or re-ordered, or if there was extraneous 
information which could be eliminated, etc. Practice in doing 
the stra*'egy was then provided. The resulting gains in student 
achieveuent on math word problems were quite remarkable. After 
only three' instructional sessions, students learning how to 
clarify problems by drawing a diagram achieved scores which 
were 300% better than those of students who did not receive 
instruction in that strategy. Students who learned how to 
identify and eliminate information extraneous to the problem 
scored 344% better than students who received no instruction in 
how to eliminate extraneous information. And, students who 
learned how to re-order problems scored 144% better than 
students who did not. The researchers note, however, that the 
test problems given required one manipulation only, and that 
"real life" math problems encountered in school texts often 
involved a number of complexities which may cause ambiquity in 
comprehension for the student. Nevertheless, the findings are 
impressive. 

This series of studies demonstrates again, as did the 
Pressley study, the type of research which classroom teachers 
might readily incorporate into their normal classroom 
activities. The researchers investigated only three factors 
related to matb wotd problem comp^-ehension; many more factors 
remain to be addressed. 
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This study was conducted over a period of ten weeks, and 
attempted to understand how instructional strategies might be 
manipulated in order to encourage second-grade children to 

ERIC 216 



LANDSCAPES: TEACHER-RESEARCHERS 



10:11 



engage in making inferences based on their reading. While the 
length of the study enabled the researcher to observe more 
reliably than otherwise the effects of the strategies she 
introduced, the treatments weie conducted apart from the normal 
activities of the classroom. Materials normally used in 
classroom instruction were, however, used in the study. 

Hansen wanted to find out whether inferencing could be 
encouraged in the classroom setting among second-grade 
children. She was particularli interested in investigating the 
effects of two strategies which were predicted to enhance 
inferencing ability. The first strategy was that of relating 
nevs information to the already existing background knowledge of 
the student; the second strategy was that of increasing the 
frequency with which the teacher posed inferential questions, 
the idea being that students respond in ways expected of tnem 
and in ways in which they have had frequent practice. 

Ten stories were taught to three groups of students (two 
treatment groups and one control group), each over a period of 
four days. One treatment group engaged in a pre-reading 
activity designed to help students activate their background 
knowledge and relate it to elements in the story. The other 
treatment group received aH inferential questions following 
the reading of the story. In all other ways, both treatment 
groups were dealt with in the same way as the. control group. 
The control group followed the normal procedures of a basal 
reading lesson, i.e. initial vocabulary instruction, a pre- 
reading activity, guided reading with a ratio of 5:1 of literal 
and inferential questions, and finally phonic and skills 
activities. 

Hansen founc'' that both the background strategy treatment 
and the inferential questioning treatment improved the 
inferencing scores of students in the classroom setting. Of 
the two treatments, the background strategy treatment seemed to 
have a greater effect on inferencing performance than did the 
inferential questioning treatment. Of interest as well was the 
finding that the recall of literal information in the stories 
was greatei in each of the treatment groups than in the control 
group, which focused primarily on literal level information. 

This study is highly suggestive for the classroom teacher 
who is concerned with helping students deal with material at 
higher levels of comprehension. It also suggests to teachers 
paths of exploration which they could formally, or informally, 
pursue in their own classrooms. 
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This study was conducted over a period of seven months and 
involved extensive cooperation between the researchei and the 
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classroom teacher. Siegel was interested in understanding how 
children arrive at interpretations of things they read. She 
spent the first three months of her time in the classroon* in 
observing the teacher and the children in their usual 
interactions. During the final four months of data collection, 
she met with groups of students and observed their sketches and 
interpretations of stories which they read together* Tiic 
interactions were audio- and video-taped; interviews with 
students were collected as well. 

Siegel found that children were influenced by five factors 
in interpreting texts through the medium of sketches: 1) by 
their ideas about what the social situation required, 2) by 
their perceived skills as artists, 3) by the nature and 
constraints of sketching itself, 4) by the interactions they 
had with their friends, and 5) by their degree of interest in 
the material. All these factors came into play in influencing 
the interpretation which a child arrived at after reading a 
story. 

is clear to any classi^oom teacher, that a study of this 
nature involves a high degree of cooperation between the 
researcher and the teacher, i^lthough the teacher was herself 
not directly involved in much of the data collection in this 
case, her cooperation was crucial to the success of the study. 



5ty^y 5 J Be^p^ Singei^ Sajt^j, i El^^ee iJL253J^ Di£S£t 
iDst^uctipc in Met^cogDii-iye Siiatsgies* 



ERLC 



This study it an example of the kind of research which can be 
done when teachers collaborate with researchers. One of the 
authors of this study. Jack Sorter, is a classroom teacher of 
tenth-grade world history. In the study, the investigators 
wanted to find out v/hether outlining and graphic organizers 
(structured overvie^^s, diagrams, and flowcharts) helped high 
school students better comprehend textbook materials, and 
further to find out which of the two strategies was more 
effective in doing so. 

The teacher, Mr. Sorter, instructed his students over a 
twelve week period in the strategy of developing graphic 
organizers after reading their history texts. Two classes 
received this instruction; one of the two groups had previously 
received instiuction in writing summaries of history texts, A 
third gioups received instruction in the traditional strategy 
of 'outlining . The investigators found that on subsequent 
quizzes, when either the graphic organizer strategy or the 
outlining strategy were required of students, comprehension was 
equally facilitated. Vihen they looked at later quiz 
scor es, however , when no strategy was required of students, they 
found that students who had received the graphic organizer 
instruction scored significantly better. This indicated that 
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students v^eie irore apt to use the graphic otgoni/.et stiateg^^ o£ 
their own volition than they were to use the traditional 
outlining strategy. 

When the investigators cort^pared student attitudes 
regarding the two strategies they found that students had 
signif icantli more positive attitudes about the graphic 
organizer strategy than they did about the traditional 
outlining strategic Since attitude toward strategies strongly 
influences the use of strategies, this is a finding which 
teachers can fruitfully apply to their classroor. situations* 

The investigators went one step further and examined the 
effectiveness of these strategies on material which was very 
challerging to the students. When the students were required 
to sumiTiarize that nrucerial, the researchers found that the 
graphic organizer strategy was more effective than the 
outlining strategy in f acili .c*.t ing summarizing; when students 
had previous experience in summarizing and had instruction in 
developing graphic organizers, their sumn«aries wore 
significantly better than those of students who were instructed 
in the traditional outlining strategy alone. The writers 
report that students using the outlining strategy often 
complained that trey had difficulty in knowing how to begin 
their summaries. 

This study demonbtratfes a numl)ei of things to potential 
teacher-researchers. First of all, it is an example of a study 
in which a teacher v/as an cJCtive participant in the research 
upc"! * tc^ken, and in the presentation and publication of that 
research. Secondly, it" demonstrates the kind of information 
which can be gained fron longer-term research ir. the field; a 
one-shot, short-term study strategy instructional session and 
subsequent te^^t of 5ts effects wouJd have yielded meager 
information. Strategies are learned over time,- and consistent 
instruction in these strategies is what this teacher study 
provided. 
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This study wds conducted over a period of one school year and 
involved the cooperation of 27 first grade teachers, each 
coopeiating throughout that entire period. The purpose of the 
study was twofold: 1) co measure the effectiveness of 22 
principles of reading instiuction whicl- v/ere thought to be 
important, and 2) to investigate the extent to which teachers 
actually carried out innovative methods of instruction. 

The 22 principles of instruction included things as 
diverse as consistent signalling to get the attention of 
^tudentb to appropriate responses to students' reading 
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probleniS/ and veie repoxlecl in teriris of 55 separate scores* 
Significant differences vote found in sonie cases and in ijuipe 
cases were not. What is of interest here are the conclusions 
of the study, vhich were E^ade possible by the length of tiir*e 
ever v/hich the study was undertaken and by the extent of 
teacher cooperation. 

Teachers were observed throughout the year in order to 
ascertain whether or nut they were indeed carrying out the 
intended instructional strategies. This was ijnportant since 
the results of the study, i.e. the effects of instruction, 
depended upon that instruction actually being istfplemented. The 
researchers found fror. their observations of the teachers that 
nu all the instx ucticnal strategies were being impleniented, nor 
were all being implemented consistently. Furtherrrore, among 
the teachers in the control group, who had not received 
training in the 22 principles of instruction, many were using 
some of those practices as part of their own instructional 
approach. In short, the long-term observations of teachers 
enabled the researchers to evaluate more realistically their 
findings legarding student achievement and instructional 
principles. They were able to temper tbeir Cjoi^ms with an 
unusually rich tank of information rec;arding v/hat actually 
happened in the classrooms. 

This type of research clearly requires exceptional 
dedication on the part of both researchers and teachers in 
order to docunent the goip.gs-on in classrooms. The results, 
however, while inevitably lec^s cut and dried, reflect more 
closely what is actually occurring in our schools. 



A CLOSM? VIEW yF li^i- TMCBER AS E^RWB^B 



The followir.'j tassage (Clyde, 1985) is based upon fieldnotc-s 
Kept bi-a teacher-restarcher who is engaged in research in her 
cluSsrooFi along with a professional researcher. It 
deroijstiates the waj in which the teacher-researcher explores 
instructional strategies and i.iats out future paths to follow. 

"Susan Gibson, a special education teacher, has forced a 
collaborative lestaich partrorship with Julie Wheeler, a 
doctoral student from Indiana University to investigate 
lileraci in learning disabled youngsters. In dcing so, she has 
accepted the responsibilities of a full-fledged researcher. 
Ain.ed with a field notebook and pen, she documents literacy 
events in her classroom, recording kids' responses to 
activities, reflecting upon mure successful and less successful 
lamjua^e encounters, and generally subjecting her instructional 
decisions and theoretical assumptions to constant and careful 
^iciutiny. 
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"Since the study began in Januaii/ Susan ar.t3 Julie fiave^ 
tcgethei initiated i.iani nev ext-eriences which have chalicr.ycu 
tr.eir> to keep a close eye on not only the students, but 
themselves as well. In sharing her teaching tesponsibiiitiei 
\vith Julie, Susan hat begun tv take a new look at herself, tu 
ccn.paie and contrast theii t\vc very different stales while 
Julie has began to undetstc>nu the complexity of ncvir.g fron 
research to practice. 

"Perhaps the biggest eye opener of all has been the 
success of a letter exchange with college-aged penpals. For 90 
Rdnutes after her students received their first letters, Susan 
witnessed a genuine interest and participation in real 
literacy. Students shaied the letters the^ received with each 
other and with the teccher, tl.ey composed letters together or 
shared ones they had composed with other students. , and they put 
a lot of effort into laking nice envelopes for their return 
mail. Neither Susan nor Julie found themselves- prompting them 
or trying to keep theni on task. The students were geniunely 
absorbed in the experJLence. 

"Not icng afterv/ards, on a day on V/hich Susan had sole 
charge as both teacher and iei>earcher, she atten.pted another 
activity with hei class, one which she felt, on the basis of 
her discussions with her research partner," had nuch in coniiuon 
with the popular penpal project. Students were to check out 
books from their newly planned and created claisroum libre-iy 
and read thei. in groups or alcne, as they chose. Through 
Sudan's fieldnotes, ue join the children, their first 
tvj.erience at uninterrupted reading already in progress. 

• Susan: "Kichael and Shawn. Remer.;Lei , you were going to 
sit together und read your books." 

Shawn holds a book in each hand and starts swinging 
arcund like v windmill. Shc.wn and Michael go back to 
the cubby, and their heads p^^'P "ir/ "Katthew, you wrote 
bad words in here." 

Matthew (angry): "What?" (Goes over tc uutty to see 
what they cie talking about.) "I didn't write that." 

Shawn and Hichael (teaiing sound to v.'Xcc): "Oh, yes 
you did." 

Michael starts raking various noises like 3 cud 
"r'noiting and thc-j> cor.es out of cubby vitl r ii bocks. 

Susan: "I^ichael, I want you to cor..e back tc your own 
secit now and road ycui book." 

Kichacl: "I hate to road booki."' 

"The scene continues, with Susan concicdin*, hc-r fieIC 
notes with a neno to herself, a 3ist of yuei-ticj-;* which ijLc 
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feels iTust be addressed by both her and Julie. 

What are our goals for this library time? 

If our goal is for them to read and they won't 

voluntarily, what are our alternatives? 
What aspects of the penfal experience r.iade theni so 

eager to read? 
How are library books different from the penpal 

letters? 

Are we presenting the library books too soon? 
Do we need to n.ake books with them first?'" 

Susan waL- engaged in the exploration of a new 
instructional strategi in her classrooir.. Teachers find 
theniseives in this situation frequently in the course of their 
trying to nurture the growth of their students. Susah'i 
situation was special i;i that she was making a self-conscious 
attempt to document her exploration of a new strategy and the 
result of its use with her class. It is this documentation of 
a planned exploration of an instructional strategy which 
constitutes research into classroom instruction. 
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The studies v-hich have been discussed in this chapter 
dertonstiate several things to the classroom teacher. First and 
foremost, they demonstrate that research into reading 
cor.prehension at :t occuis in acticn in classrooms is highly 
dependent upon teacher-researchers. Without the extensive 
cooperation and involveneul of classroom teachers, ric^orous 
field research is impossible. 

Teachers who wish to puisue their role as lesearchers can 
liciKe particularly ui»eful cuntributions to reading comprehersion 
re«^earch by basing their research on the strengths of their 
position vlthin the classroom: 1) Teachers have the opportunity 
to plan, undertake, and r.odify instructional strategies m 
their classrooms. 2) Instructional strategies can be 




4) Since the length of time of the study is, as such, not a 
crtcial factor in investigation for a teacher-researcher, 
hypotheses arrived at earl^ in a study can be verified and 
refined through further modification and testing of the 
strategy in question. 

Ir suj.iiari, teacher-researchers should capitalize, for 
purposes of research, on their power within the classroom to 
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legitifidze instructional activities/ on their daily contact 
v^ith learnerS/ and on the extended periods diiing which they 
have contact with the same group of learners* 



In this discussion of the overall findings and of specific 
exaiTj-los of leseaich being conducted in improving reading 
comprehension/ I have argued that teachers have an important 
role to play in furthering our knowledge of this important 
aspect of learning. Teachers need to see themselves as 
explorers. They, irore than anyone else in the field of 
education/ have the opportunity to observe children/ to draw 
hypotheses regarding children's learning needS/ and then to 
investigate these hypotheses in their own classrooms. Teachers 
can invite the collaboration of professional researchers in 
making their insights known ^ or they can take it upon 
themselves to develop their own abilities to communicate their 
findings in public forums 3uch as journals and conferences. 
There is much to learn about how children learn/ and teachers 
are closest to that process in action • 



1DE^5 EQE HPF TO BEG115 



Two national organizations which have made it a priority to 
encourage research by teachers in their classrooms/ either in 
collaboration with prof esidonal researchers or independently/ 
are: 1) The IJational Council of Teachers of English/ and 2) The 
International Reading Association^ Each offers grants to 
teacher-researchers and provides advice regarding proposal 
writing and regarding the research process itself. 

There are a number of publications which are eager to 
receive articles written by c3ai-biuom teacher-researchers. 
Some of these are: 

The English Journal Journal of Reading 

Language Arts Learning 
Livewiies The Reading Teacher 

State IR/i journals 

If you have a researcl idea but would like to collaboic*te 
with a professional rcsectrcber/ contact the Fducation 
Departnent o£ a local university or college. Collaborative 
research project:: with other teachers in your school or in yoiM 
district can be a rewarding and enrichir4y e:<perience as well. 
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^EETI^3G AT THE CROSSROADS: 
MEASUREMENT IN RESEARCH AND IN CLASSROOMS 

Patricia Tefft Cousin 
Indiana University 



ICTRODUCTION 



The assessment of reading conprehension is a fundarental concern of both 
teachers working with students in a classroom and researchers studying the 
reading process. As soon as a new group of students enters a class/ the 
teacher oegins to assess their reading comprehension. This assessment of the 
reading provides information for planrdng instruction and for setting goals 
for individual students. For the researcher studying reading conprehension/ 
the development or choice of a measurement instrument is one of the most 
critical decisions the researcher will nake. In both the instructional and 
research setting, the method chosen to measure reading structures, if not 
determines/ what will be perceived and what will be valued. 

This paper contrasts the assessment of reading conprehension in research 
studies with that which goes cn in classrooms across the country, l^ile 
differences between research and practice will not be ignored/ the focus will 
be upon the search for a comnnon ground on issues related to assessment. I 
will argue that there can be a "meeting at the crossroads" in the area of 
assessment between researchers and teachers. I will conclude that 
collaboratively the perspective of the researcher and the per^>ective of the 
teacher can serve a self-corrective function relative to future work in the 
area of reading conprehensico assessment. 

We are all aware of the enphasis on group assessment/ particularly the 
use of standardized achievement tests and minimal competency tests. No one 
can deny that often the scores on these tests are inadequately and 
inappropriately interpreted both within and outside the educational field. 
The test results are often used for purposes never intended by the test 
developer. Johnston (1984) argues that our present testing paradigm with its 
enphasis cn group assessment must be challenged because it is based on 
sinplistic if not faulty assumptions. Since we know that the conprehension 
process is oonplex and multidimensional/ the assessment of that process nust 
be likewise complex and multidimensional. We new know that assessment 
results are not only affected by the test/ hut also the strategies and 
knowledge that the test taker brings to the testing situation. One test 
score provides coly one indication of the reader's abilities. A single test 
score provides a single perspecive on conprehension. The collaboration of 
researchers and teachers in the area of assessment could lead to challenging 
current practice and thus affecting the current status quo in reading and 
assessment. 
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I do not dismiss the fact that assessment is often used for different 
purposes in comprehension research* studies Uian it is in classroom and school 
programs. Researchers choose a method of measurement which will further 
delineate the process of comprehension. In contrast/ assessment in scIk>d1s 
provides inforroticn for raking decisions about students and programs 
(Pearson & Jcrfinson/ 1978). School assessment is often used tor the 
comparison and classification of students. Assessment in schools ranges frcin 
the individual assessment of a student to the evaluation of a system-wide 
prx>gram. Yet despite these surface structure differences, I will argue, all 
assessment of reading coirprehensicn shares the ultimate goal of improved 
instructional practice. 

I will discuss three areas related to assessment in this paper. First/ 
I will discuss assessment from a research perspective. This review is based 
on a d^ta bank of reading comprehension studies published from 1974 to 1984/ 
gathered as part of a federal contract. Second, I will discuss classroom 
assessirent. The issues discussed in the first sectiori will be refocused and 
cc«isidered from a practitioner's point of view. A third section will take a 
close look at an actual instance of what classroom assessment looks like when 
It incorporates new insights in the measurement and assessment of reading. A 
final section will sumnarize the key issues drawn from both research and 
practice for purposes of explicating a future agenda. 

The purpose of this paper is not to discuss or review all t\e 
ccnplicated issues involved in the area of measurement and assessment. 
Others have discussed many of these issues in detail (Farr & Carey, in press: 
Jc^nston, 1983: Johnston/ 1984). Rather/ I am reviewing how assessment is 
used m research and m classroom settings, emphasizing the need for teachers 
and researchers to share their expertise vith each other. 

Like research and instruction, assessment needs to be theory driven. I 
take the position that ultirrately any assessment in reading takes as its goal 
the inprovement of instruction. To fulfill that function assessment nwst be 
fccused on the individual and situated in particular contexts. 



MEASUREMg^T IN READir.XS 0Q^^PR£HENSI0^3 RESEARCH 



Research m the area of reading conprehensico has changed and expanded 
tremendously over the past ten years as researchers have tried to define 
readme. Reading is viewed as a cognitive process and research has moved 
fron a "product to a process orientation (see other [papers in this volume by 
Harste, Rowe, and Short). However, this expansion of our knowledge tese 
about reading has not affected the measurement area, in either research or 
practice/ as significantly as one would expect. VJhile reading researchers 
qenorally do not view reading as an information transfer, many assessment 
instruments are still based on this premise. 

As a result, assessment does not always reflect current understandings 
about reading coirprehensicn. "Research findings of late have tended to 
enphasize the importanoe of process over product/ yet eduwtcrs and 
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researchers persist m depending on the more conventionally obtained product 
data" (Johnston, 1984, p. 175). 

This partially results from our inability to really measure the actual 
process of reading. Since reading is a mental process/ it is diffiuclt to 
develop measures which will expose that process. "Our ability to study the 
process of reading has not kept up with our good intentions; and we are 
forced to resort to the product as an index of the process" (Farr & Carey, in 
press, p. 19). 

Even researchers who are studying the higher level processes of reading 
and cognition in general choose nore product oriented measures (see Short, 
Chapter 7, in this volume). There still renains the need to identify 
assessment strategies which effectively measure the reading process as 
defined by researchers in the field. This search for new methods of 
assessment has led some to study reading in more naturally occurring 
situations. It has also encouraged the use of non traditional types of 
measurements. These issues and others will be discussed in the section which 
follcws. 



Issues in the measurement of oonprehension 



A review of reading comprehension research reveal several issues related to 
tne measurement cf comprehension which merit discussion. These include: (1) 
tne Kinds of measurements used in comprehension research, (2) the development 
and use of new nontraditional types of measurements, (3) the use of 
experimenter developed measures of corrprehensicn, (4) the use of nwltiple 
measures o£ conprehension in a single study, and (5) the relationship between 
the type of measurement and conprehension gains. 

Kinds of measures used. Many different kinds of measures have been used in 
research studies to assess conprehension. These include a very diverse group 
of measurement instruments ranging from vocabulary tests to methods of 
analyzing whole texts. The use of instruments which measure small units of 
language appears to be decreasing, while the use of tests or instruments 
which TCasure larger linguistic units are increasing. This is not surprising 
since a great deal of recent comprehension research is now focusing on 
understanding how readers process texts, rather than hew they deal with 
snaller units of language. 

There are several kinds of measures that are typically used in research 
studies. The kind of instrument used most frequently to measure 
conprehension ability has been a set of conprehension questions. This type 
of neasure includes multiple choice questions, true-false questions, and 
open-ended questions among others. The use of questions as a measure of 
comprehension has been a consistent choice of nany researchers over the past 
ten years partly due to their efficiency and ease of use. 

In one stud>^ a multiple choice test, developed for use in the study, 
consisted of seven inconi^lete statements, one why ^^ucstion and one sequencing 
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question. All of the nine items were followed by a list of four to six words 
or phrases from which the student was to choose the answer. The test was 
designed to measure the student's literal and inferential cortprehension. Two 
forms of this test were used in the study (Kameenui, Gamine, & Freschi, 
1982). Assessments of this type are also an integral part of classroom 
assessment practices. 

^ Retellings, recalls, or sumnaries have also been a connmon choice of 
researchers, although their use has varied from year to year. The analysis 
of this type of measure is very time consuming. 

An oral recall task was one of the measures used in a study by Graves, 
Ccxke, and LaBerge (1983). These recalls were transcribed and a 
prepositional text base was constructed for each passage. The propositions 
in each recall were matched to the propositions in the text base and counted. 

Another type of analysis of oral recalls was used by Hansen (1981). The 
recalls in her study were analyzed for the prevalence of inferences. Three 
forms of recall were considered, including textual infornation, scriptal 
information (knowledge the student brought to the reading process), and 
intrusions (knowledge considered extraneous to the task by the researcher). 
Each study using recalls or retellings as the measure of conprehension 
seemingly structures the analysis and interpretations of the recalls somewhat 
differently. 

The use of cloze tests and vocabulary tests as a measure of 
conprehension has been less frequent than the measures previously discussed. 
A study by Sampson, Valmont, and Van Allen (1982) used two types of cloze 
tests and a vocabulary test along with a reading conprehension test. The 
cloze tests were scored by a senantically consistent scoring system. The 
nunfcer of different responses which were considered acceptable were also 
tallied. 

Phonic tests, reading rate tests, and miscue analysis are not coititvot 
measurement choices of researchers doing conprehension research. While this 
nay not have been the case throughout history, it is, nonetheless, true of 
reading conprehension research during the past 10 year period. In many ways 
this is unfortunate as nuch, seemingly, could be gained by addressing what 
really constitutes a "miscue" in terms of a retelling fol? owing the reading 
of a selection. 

Norm-referenced measures are tests in which an individual's score is 
conpared to the scores of other individuals. Tables of norms are prepared by 
the test developer. These tables are based on scores that are obtained on an 
appropriate group of subjects (Borg & Gall, 1983). These types of tests are 
infrequently used in conprehension research except in some of the classroom 
instructional studies. In these studies norm-referenced achievement tests 
are given for the purpose of defining general group achievement levels. For 
exanple, Tharp (1982) oscd achievement tests to conpare the experimental 
group, in a special reading program (KEEP), to control groups classrooms (see 
Dahl in this volume for further discussion of this successful program). 
Apparently, for most researchers, norm-referenced tests do not assess those 
behaviors which they see as central to understanding conprehension. This is 



227 



LWmDSCAPES: MEASUREMENT 



11:5 



one area where research and practice follow very different paths. Schools 
strongly eirphasize the use of nornt-referenced tests, usually group 
achievement tests/ for nonitoring conprehension abilities. 

A review of the kinds of measures used in conprehension research 
indicates two other trends. The kind of measures used in the special 
education comprehension sti»Jies did not differ significantly from those with 
ncffilabelled students {see Stephens in this volune). Secondly, the measures 
used by researchers in classroom instructicxial studies did not usually differ 
from studies which do not include some type of conprehension instruction. 

Use of nontraditional measures of comprehension. Non traditional or 
nonstandardized measures of reading comprehension have also begun to appear 
in research studies. These methods reflect newer orientations toward 
conprehension and acknowledge the complexity of the reading process and of 
extralinguistic factors that influence the reader and affect conprehension. 
Hu-Pei Au and Mason (1381) used videotape analyses of class participation 
structures to study the relationship between participant support structures 
and reading achievement. Weaver (1979) used tests on sentence anagrams in 
her study of the effects of sentence organization instruction on 
conprehension. While nontraditional measures are still not widely used, 
their use is increasing. 

As we have mentioned, there is still a search for measures that provide 
more infcrnBtion about the process of reading. Protocol analysis is a method 
typically used by researchers studying problem solving, in which an 
individual thinks aloud as he solves a problem. Some researchers consider 
that this type of measurement provides infornation about the process of 
reading/ while minimally interrupting the reader. Olshavsky (1977) and 
i\avale and Schneider (1979) used protocol analysis in their studies related 
to readers' use of specific strategies. Hare and Smith (1982) used two 
methods of self reports/ retrospections and protocol analysis, in a study of 
the metacognitive reading skills of children in elementary school. 

Recently, some researchers have been using written texts proAiced by 
students as indicators of reading conprehension. Such measures inclucfe the 
analyses of written surnrarizations of text passages as in the study by Hare 
and Borchardt (1984). The use of writing as a measure of conprehension 
appears to be increasing. We can probably expect more development in this 
area in the future because there is more attenticxi devoted to studying the 
relationship between reading and writing. 

As researchers better understand the reading process, new methods of 
measurement can be expected to be developed. The integration of new methods 
of assessment with established methods will provide a more conp7ete profile 
of a reader's conprehension abilities. 

use of experimenter-developed measures . Many comprehension research studies 
include a measure of conprehension which has been developed by the 
experimenter. In a stuc^ by Linden and Wittrodc (1982)/ the senior author 
developed two types of posttests for each of the stories used in the study. 
The first was a multiple choice test of factual information and the second 
was a conpleticn test of reading conprehension. The tests were rated by 
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three judges based on the relevance and/or congruence of each test item to 
the story^ Criteria were also developed by the authors for use in judging 
the type of generations the children produced. The researcher developed 
tests m this study are typical of rany in the data base that were reviewed. 

Use of multiple tneasures . Operating with the assumption that reading 
involves a group of strategies whose requirements change according to the 
demands of the literacy event, researchers are trying to assess these 
multiple strategies. Studies are seldom structured to measure only one skill 
or behavior; rather, many researchers used multiple dependent measures to 
test multiple hypotheses. Researchers ackncwledge that different types of 
measurement yield different results and interpretations of the conpetence of 
the reader. "Generally it is considered better to assess ability using a 
variety of tasks as sources of infornation/ since each provides different 
infornation" (Johnston, 1983, p. 59). With the use of several different 
measures of oonprehensicn, the researcher is able to develop a more conplete 
picture of the reader's conprehension strategies and corrpetencies. For 
exanple, Raphael and McKinney (1983) used conprehension questions, a free 
recall measure and a reading achievement test in their study on 
question--asking behaviors. 

Researchers tend to choose the type of conprehension measure which will 
most likely provide them with infornation related to the aspect of 
conprehension which they are studying. As we reviewed conprehension 
research, we found that researchers are using a continuum of measurement 
instruments which ranged from structured to open-ended. They triangulated 
tne results of tnese assessments to better understand the comprehension 
process. They chose product type measures and measures that are more process 
oriented. We can use both types to provide a more conprehensive profile of 
tne reader. Wmograd (1383) used several diverse types of assessments in his 
study. InclucSsd in tiis study was a word list test, multiple choice 
questions, summaries of test passages, ratings of the inportance of each 
sentence to the text, and short answer interview questions. His measures 
represented both structured and unstructured types of measures. 

Special education conprehension research studies also tend to use 
multiple measures. In a study by Vtong and Jones (1982) on the self 
questioning behavior of learning disabled and nornally achieving students, 
five measures were used. These included the number of idea units underlined 
in test passages, the nunber of cn-target questions generated by the 
subjects, the perfornance on reading conprehension questions, a recall 
measure, and the time required to conplete the assignment. These measures 
also represent a range of measurement instruments. 

Measuren^nt and conprehension gains . The results o£ con^jrehension research 
studies do not differ when classified according to the kind of instrument 
chosen to measure conprehension. The one exception is that studies using 
measurements that are not norm-referenced report more positive cont-^rehension 
gains as conpared to studies using normed m3asures. 
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A SuiTOTQcy of the Trends 

Although the area of assessment has not always reflected the nost recent 
theory and inquiry in the field of reading, there are several issues which 
indicate changing perspectives- A review of the kind and type of measurement 
methods used in reading coirprehension research over the past ten years 
indicates several trends. These include: (1) the use of assessment methods 
which measure larger linguistic units, (2) the development and use of new 
ncffitraditicml types of measurement/ (3) the use of experimenter-^ve loped 
measures, and (4) the use of several types of oonprehension assessment in a 
single stu<^, rather than reliance on one method of assessment- Researchers 
are using several assessment methods in an individual study ranging from 
structured to more open-ended types of measurement- Since corrprehensicn is 
not a unitary skill, it is unlikely that a valid assessment of the process 
can be ireide using a single measure - 



CLPJ5SR0QM ASSESSME2^T AND MEASUREf4EI^T 

This section attenpts to reconsider and refocus the trends discussed in the 
first section from the perspective of the practitioner- Specifically I will 
discuss: (1) the kinds of measures used in classroom assessment, (2) the 
Development and use of new nontraditional types of measurerent in classrooms, 
(3) the use of teacher developed measures of oonprehensicxi, (4) the use of 
rrwltiple measures for assessing the coirprehension of a student, and (5) 
assessment and classroom instruction- Assessment in schools is affected by 
nany extrinsic factors as compared to assessment in research studies- This 
both oonplicates assessment issues and poses barriers to change- 



Kinds of measures 

Teachers use many of the same kinds of measures in their classroom as are 
used in research studies. Theoretically quite divergent measures tend to be 
mixed and natched in most school settings- Teachers oomnvonly use both 
individual and group types of assessments- Individual assessments include 
infornal assessment and observational methods- Oral questioning, coiriDonly 
used as part of reading instruction/ is typically focused on the individual 
rather than the group- 
Group measures include criterion-referenced tests developed for use with 
a reading series and norm-referenced group achievement tests- Group 
achievement tests in schools are an efficient and cost effective method of 
evaluating a large group of students, thus they are widely used* Some school 
systems also use skills tests related to assessment of miniriBl conpetencies. 
If the types of measurement used in classrooms were categorized according to 
the classification we consi jered for research studies, the latter three types 
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would mainly be classified as vocabulary and corrprehension questions. 
Practically/ what this means is that many important aspects of reading 
conprehension are not being assessed given current classroom assessment 
procedures- Informal assessment is the nain type of school assessment which 
considers a process oriented perspective on the reading process. 

In special education classrooms assessment practices tend tc be more 
individually oriented. Individual norm-referenced achievement tests and 
criterion-referenced diagnostic tests are often used by educators working 
with both the gifted and the learning disabled. Special education teachers 
do tend to know more about assessment because teacher training programs in 
special education comnronly include a course on assessment or diagnosis. The 
orientation toward assessment from a special education perspective tends to 
focus on the learning problems of the student. These assessments are 
supposed to indicate areas for individual instruction, although many of the 
instruments do not seem to have a close correspon(fence to the tasks that 
children are asked to do during instruction in reading conprehensicxi. 

In contrast to research, the choice of assessment methods in schools 
tends to be atheoretical, that is, the decision to use a specific type of 
assessment is not based on any instructional theory. Assessment decisions 
are often nade by individuals other than teachers. Thus, there often is \a 
helter-skelter approach to assessment in classrooms/ rather than a choice of 
assessment methods based on a theory of learning and the plan for instruction 
in a specific classroom. 

It seems clear that school-based assessment, like assessment in 
research, needs to include measures that are more process oriented. For 
exanple, an important area of comprehensicxi research has been the 
investigation of metaconprehension abilities. This refers to the skills by 
which the reader monitors his own progress and analyzes the denands cf 
individual tasks. While metacognition is an important area of inquiry in 
research, the assessment of metacognitive skills of readers is rarely 
included in school programs. 

An exanple of such research is a study by Raphael and McKinney (1983). 
They studied fifth and eighth grade students' awareness of information that 
was explicitly stated in the text, or inplied by the text pr from the 
student's own knowledge. They ccxisidered how this awareness affected the 
ability to answer questions. A training program was organized to prorrpt 
students to consider these three relationships between the question and the 
source of infornaticffi used to answer the question. Training was found to be 
effective for both groups, while prorrpting was only effective for younger 
students. 

Research information of this type could easily be included in classroom 
reading instruction. Unfortunately, teachers are often unaware of new 
infornation in the area of assessment. This and other insights in the 
assessment of receding comprehension need to be communicated to practitioners. 

We would be naive to ignore the fact that some measurement methods used 
in research studies are inafpropriate in their present form for use in the 
classroom. Many research instalments require conplex implementation 
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procedures, one-to-one acSministration, and time cx>nsuming analyses of tl 
results. Since teachers have lindted time to devote to assessment, the 
measures are unrealistic- Researchers should consider devoting time to 
adapting such measures for use in classrooms. 



Mew types of assessment 



New kinds of assessment methods need to be introduced to teachers, 
particulary those assessment procedures which highlight strategic behaviors 
in the reading process. Assessments procedures which can both be used to 
teach and to assess and measure progress at the same time appear to have the 
mDst promise. 

Writing has been used as a measure of oorrprehension in research and is 
also appropriate for use in practice. Stotsky (1982) describes writing 
strategies which can be used not only for assessment, but also for teaching 
conprehension. She suggests writing activities including dictation, 
reproduction, paraphase writing, precis writing, and sentence corrbining. 
Stotsky describes each exercise,, offers soms suggestions for inplementation 
in the classroom, and then focuses on why the exercise is effective for 
inproving the stucfent's reading and thinking. 

The assessment of metaconprehension abilities along with the teaching of 
these strategies might be another of promise. Bean, Singer, Sorter/ and 
Frazer (1983) investigated whether the use of outlines or graphic organizers 
helped the students to better conprehend textbook materials. The students 
learned strategies for conprehending, while their conprehension abilities 
were being assessed. Geva (1983), planned to inprove reading conprehension 
by requiring students to develop a flowdiart representation of a paragraph. 
The author proposed the use of flowcharting as a means of assessing and 
teaching less skilled readers to understand the structure of the text. 

Another new assessment perspective is that of "negotiated testing." In 
negotiated testing the teacher observes how the child perf;:rms independently 
on an assessment task of the teacher's choice. The teacher then compares 
perforitance in this setting against performance in a setting where assistance 
— either adult or child ~ is provided. In this way the student's '*zone of 
proxiiTBl development" is identified. This zone, according to Vygotsky 
(1978), represents the area where instruction would be most beneficial. 
Feuerstein calls this type of assessment "dynamic assessment" (Brcwn & 
French, 1979; Feuerstein, 1979/ 1980: Johnson, 1984; Vygotsky, 1978), These 
views of assessment are irrportant because social interaction and support is 
considered a part of the process, not as separate entities apart from 
instruction. 
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Teacher developed assessment measures 



One of the bright spots in classroom assessment is the use of informal 
assessment and'observation. These observations often do focus on the process 
of conprehensico rather than on the products of oonprehension- The 
individual teacher's methcds. ot infgrnally evaluatina a student's progress 
prccably provides irore inforrtation on the comprehension abilities of a reader 
tnan ar^' test score. But these observation are usually never "synthesized 
and reported" in any nanner (Farr & Carev/ in press)- 

Teachers have developed a repertoire of methods to assess the student. 
But they often tend to consider this assessment from nore of an intuitive 

ir^ective rather than as a systertatic and conplex method of gathering 
infcr.TOtion about the student's corrprehension abilities. Teachers' 
oDservations are too often not sanctioned. We need to place more eirphasis on 
tnese assessrrents. Teachers must reassert themselves as experts and decision 
iiatvers and renew their confidence in Jie knowle^e they possess about their 
stuoents. The tremendous base of assessment kncwlec^e that teachers possess 
IS an area that also needs to be explored and considered by researchers, 
infornal assessment methods often effectively demonstrate the influence of 
the many factors that influence reading oonprehension. 



Use of irajltiple measures 



Earlier I reviewed the use of nwltiple neasures of conprehensicn by 
researchers. The purpose of using nultiple neasures to assess reading 
conprehensicn is to provide a variety of quality information about the 
reader's use of reading strategies associated with successful performance. 
While practitioners do use a variety of assessments! there often are no^ 
instructionally based reasons for the assessments that are used. Certain 
tests are often nandated for use and these test scores are often emohasized 
at»ve other infocnation about the reader. Due to administrative nandates and 
tiTC constraints/ it is easy to place too much errphasis on the accuracy of 
cne test score as an evaluation of the reader's corrprehension abilities. 
Tnis seems particularly true at the upper gratfe levels where there is less 
snail group instruction. Teachers have less individual interaction with 
students and a limited nunfoer of opportunities to assoss the students. As 
researchers have found/ ti:G profile of a student's competencies can be very 
different based on the testing situation and the type of tests that are 
given* 

kesearctjers have studied different assessment situaticns and consiwred 
rsow a student's behavior var es according to the n^asure used. A corrfaination 
ct mfcrnation seems to be essential to provide a more accurate assessment of 
the comprehension processes that are used by the reader: 

, . . , A fair proportion of the proble^ns might be solved by taking a 
broader perspective on reading corrprehension. Standardized tests 
have generally restricted our thinking to proAict-type tests when 
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ve should be more concerned about corrprehensicn processes and 
retaconprehension {Johnston, 1983/ p.68). 

When using normed tests, researchers are suggesting that one needs to 
lock for the reason behind the response given by the student on a particular 
test sjuestion. This is usually OTly possible if one individually asks a 
stu<fent about his reasoning for ^ .specific respcnse. Langer (1983) studied 
tne oonprenension processes that readers used to understand test questions cn 
norm-referenced tests. She reported that some readers chose an incorrect 
response that was based on "interpretations that are contextually acceptable" 
{p. 15), The readers had logical explanations for their interpretation of 
the meaning of the test passages. Langer concluded that "standardized tests 
do not measure the processes involved in the construction of meaning from a 
text nor do tliey evaluate an individual's ability to nanage these processes" 
(p. 33). 

While it IS not the intent of this paper to extensively discuss the area 
of norm-refererenced iTeasurements, there is a need for teachers to be nore 
aware ^f tne relationship between reasoning and response types and to 
decrease their over reliance on any one single test soDre. Norm-referenced 
testing should be considered as only one type of measure used to evaluate 
conpetencies. In addition, researchers and teachers need to more fully study 
the situational and background factors that affect test performance. 



Measurement and classroom practices 



Assessment can affect classrooir, practice in both positive or negative ways. 
Assessment which is an integral part of classroom instruct icn informs the 
teacher about the reader and indicates areas for study. In most classrooms, 
assessment is not considered separate from instruction- 

Howeverr, assessment conoems can be emphasized over instructional 
concerns. In classrooms and schools where the test perfonrance is the 
prirary goal of inc^truction, reading instructicn tends to look like a series 
of continuous tests. One only has to hear students* negative oomnents about 
reading to see the effects of such curriculum practices. Reading is equated 
with vocabulary drills and the reading of short passages followed by nultiple 
choice questions. Movement toward such classroom practices can often be 
influenced by factors outside the school itself where individuals do not 
understand the appropriate use of these instruments* 'We do not want high 
standardiaed achievement test scores to become the goal of our curriculum. 
At most they are but one indication of a reader's perfcrnance. 



The rteasur^ment Challenge Ahead 

Classroom assessn^nt, like assessment in research studies, is conplex and 
nultidiransicnal. ;%e need to focus on reading as a cognitive process, rather 
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tnan as a proAict represented by a test score. The concern for assessing an 
indivdual should be enphasizea atove group neasureinent concerns, More than 
one neasure of conprehension should be used to obtain a ncre accurate idea cf 
a reader's ability. Finally/ new assessment nethods which focus on the 
reading process need to be inplenented in the classroom. The use of 
strategies that provide both instruction and assessment of conprehension need 
to be further explored. 

Changing assessment practices in schools is more difficult than changing 
research practices. Decisions in schools (unlike the situation for 
researchers) are influenced by factors outside the confines of the 
classrooms. One area where we might begin is the area of informal 
assessment. Teachers, building upon their developed expertise in informal 
assessment methods, need to reassert their rightful role as instructional 
decision nakers, Ke will now look at a teacher who uses assessment in a 
constructive and innovative manner to provide more appropriate reading 
instruction for her first grade students. 



TCX-JARD A PRACTICAL THEORY OF ASSESSMS^T 



Mrs. Winters, a first grade teacher, has a well organized reading program 
where the students are challenged based on the assessments that she uses in 
fter classrooB, She discussed how she used a variety of assessment methods to 
develop a profile of the reading conpetencies of each stu^nt. Her use of 
assessnent is an integral part of her theories about learning and the type of 
instructioial environment she believes is roost effective* Her reliance on 
her own expertise and 3udgnent is evident. 

Mrs, Winters related her use of infernal assessment and observation when 
a new student entered her room in mid-year. She commented how she had asked 
David to ''sit in" on each reading group and to participate in the story 
discussions. She observed his reading with different types of reading 
naterial, such as trade books, the basal reader, classroom displays, and 
mfcrnation presented at learning centers. Hrs. Winters also considered 
other behaviors which Tany don't typically consider as reading behaviors. 
She watched David for indications of naturity in following classroom routines 
ana participating in activities. She vLccrved the way he wrote a story and 
evaluated his expressicn of ideas and his use of conventions. She talked 
with him alx>ut reading, and then, after several days of observation, decided 
on the strategies and reading skills that were appropriate for him at that 
time. 

She conmented that she rarely used standardized test scores for 
instructional planning. She related, "My judgment is better than the 
infornation 1 get frcm the standardised achievement test. It really just 
verifies what 1 already know about the student," She related a classrccn 
situation to illustrate her perspective. Julie, one of Hrs. Winters' 
students, had just finished a story about a dolphin who was trained to rescue 
underwater researchers. After finishing the story, Julie said, "He {the 
dolphin) is kind of like a lifeguard," 
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In order to niake this response Julie had to recast what she had read in 
terros of her own personal knowledge o£ the world. Many researchers see this 
sort of netaphorical/analogical reascxiing as a key process in literacy use 
and learning. Mrs. Winters had observed a derronstration of Julie's 
conprehension that few existing conprehension tests ireasure. 

Mrs. Winters neintains a reading and writing folder for each child in 
her classroom. These folders contain sairples of each child's work along with 
.^rs. Winters' observations about the diild's progress. The reading folder 
lists the tyDOKs the child has read independently and the reading strategies 
and skills which are being errphasized in the class. There are also more 
personal/ mfornal conments which also indicate the child's attitudes about 
reading. The reading folder also contains sanples of the stu^nt's work 
ranging from a worksheet to a drawing of the nain idea of a story read in 
class. The writing folder includes samples of the student's writing and a 
list of the writing skills which are used consistently and those which are 
being worked on in the class. 

Mrs. Winters is certainly an exarrple of a teacher who uses highly tuned 
otservation and inforrral assessment techniques. When you listen to her 
description of a student, you are convinced that she has an accurate picture 
of the whole child as a reader, not aerely his perfornance on a checklist of 
reacmg skills. Mrs. Winters uses a variety of assessment measures, ranging 
from the stantiirdized achievement test to her observations of the child, to 
inform herself about the reader. Her use of assessment is integrated with 
her instructional techniques, such that any activities she engages in with 
her students provides her with more infornetion about their conpetencies. 



ASSESSEMENT: MSETIMG AT THS CROSSROADS 



Many might say tnat the roads of research and practice r<irely intersect. As 
teachers, it is easy to believe that reseachers do not understand the c^ily 
constraints and factors which make the assessment of reading conprehension 
only cne of the rany factors that they have to contend with each day. I 
believe that researchers have infornation to share with teachers, and that 
teachers, as developers and users of assessment in instructianl situations, 
nave i<feas to share with researchers. There can be a "meeting point" where 
tne perspectives of eadi group are shared and considered. Bela. I sumnarize 
* key differences between the perspectives of teachers and researchers for 
purposes of clarifying key issues in assessment. 

tl) The Choice of a measurement instrument by researchers is usually theory^ 
driven, while school based measuroment practices tend to be eclectic and 
hence atheorotical. 

12) Researchers usually develop their own measures, while teachers tend to 
use more standardized measures due to time constraints and 
administrative directives. 
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(3) Teachers use assessment in nore naturally occurring contexts^ while 
researchers use assessment in more controlled situations. 

14J Researchers 6d not use norm-referenced achievement tests in many recent 
coTprehension studies, while the use of these tests are strongly 
promoted in school programs- 

(5) Teachers and researchers both use multiple measures to assess 

cororehension. Researchers tend to use a combination of measures which 
range from structured to open-ended types of measures. 

(6i Both teachers and researchers are interested in identifying more valid 
methods of assessing the process of reading comprehension and what 
growth looks like from such a perspective. Both teachers and 
researchers have turned to the use of informal assessment and 
observation techniques in this search- Often, hcwever, product and 
process neasures are hopelessly cc^fused in both current research and 
practice. 



Suggestions for Implementing Changes in Assessmen t 

The orofession has reached the crossroads and new has to decide the direction 
it will take in the future. Below I suggest some areas that I consider 
inportant for inproving assessment perspectives and practices. 

U) We need to consider a new paradigm for reading conprehension assessment 
oriented upon the individual reader as learner. "The bottom line is 
that we need to worry more about the assessment process in the 
andividual/ and about the process of assessment in context" {Johnston, 
19B^, p.l75). Such a focus also acknowledges the multiple factors that 
influence the testing situation, particulary the background and 
strategies brought by the student to the testing situation. 

(2) Researdiers have long acknowledged their right to choose and even 
develop their own comprehension measures. This same right needs to be 
exercised by teachers. Teachers should be decision nakers in using 
published tests and in developing their cwn informal measures of 
conprehension. 

(3) The teacher's ejqpertise with informal assessment and observation/ 
develc^d through experience and knowledge about language learning, 
needs to be sanctioned. The results of such informal assessments need 
to be used by teachers in a more direct and systematic way. 

i4) Researchers need to communicate the new research infornaticn concerning 
the effect of extra-linguistic factors, such as cultural background and 
experience, on reading conprehension (see Heine, Chapter 9, in this 
volume). All teachers are well aware of hew tliese factors critically 
affect the child's perfornance in the classroom. They need to knew hew 
to more effectively assess these factors and use them as an integral 
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part of instruction. 

^5) There needs to be more consideration given to the assessment of critical 
reading involving the use of different types of print settings and 
naterials. Sudi assessment laist include visual materials^ graphic 
naterials, corouterized text/ and more. 

(£} An exciting perspective for practitioners is the use of reading strategy 
lessons as assessment situations which not only promote the development 
of the reader/ but also provide a picture of his or her competencies 
under varying conditions. Recent researdi in writing and metaoognition 
provide possible areas from which new strategy lesson assessment 
settings could be developed. 

(7) Teachers and reseachers need to consider "negotiated testin j/ " a 
procedure that allows teachers to see hew the student performs 
independently as compared to a setting in whidi assistance is available. 
Such settings acknowledge the social nature of language and can 
potentially lead to new understanding of test taking behavior and 
response patterns. 

(8) Given the political reality of the use of norm-referenced group 
achievement test and minimum conpetency tests, both researchers and 
teachers need to inform decision makers about the appropriate 
interpretation of test results and prevent the gross misuse of these 
tests* The content of these tests should not guide our curriculum. 
School test-taking skills are inportant/ but not the basis of a 
functional reading program. 



In this paper I have sjimarized the trends in measurement resulting from an 
analysis of reading comprehension research studies from the past ten years. 
I reviewed issues and trends related to the assessmant of reading 
conprehension from the perspective of the researdier as well as the teacher* 
An underlying assumption has been that the direction and assessment interests 
of researchers and teachers can serve to improve assessment practices if we 
but learn to collaborate. The issues of measurement are like many others in 
the field of reading — multifaoeted and not easily resolved. My tour of 
reading conprehension assessment has indicated areas where reseachers and 
teachers might find a "meeting place." This tour has pointed out some "new 
roads" that could be taken. Changes will only occur as both teachers and 
researchers work together to develop more valid measures by which we can 
assess the process of reading and its role in learning. 
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Chapter 12 



PORTRAIT OF A NEW PARADIGM: 
READI^K; COMPREHENSION RESEARCH 

Jerome C, Harste 
Indiana University 



INTRODUCTION 

I wish to argue/ based on rry involvement in a state-of -knowledge and 
state-cf~art assessment cf reading con^jre hens ion and reading corrprehension 
instruction/ that a significant conceptual change is occurring in reading. To 
give a concrete instance of what this change means in terms of instruction/ I 
quote Debbie Goodmani a teacher at the Burton International School in Detroit, 
An entry she made in her journal captures the changes that she, her students/ 
and other teachers in her school are making as they rethink reading and retake 
ownership cf their instructional program in reading: 

When I speak to parents/ I tell them that my first goal is to connect 
each child with a book. They nod their head in agreement. It does 
not seem to them such a radical idea- I have learned/ and am still 
learning hew to make my classroom an environment where children ray 
learn and may discover print. I knew hew to keep meaning/ purpose/ 
and message intact when I teach:, so that connections between -writer 
and reader are not lost. .. .VJhen I began at Burton three years ago/ the 
classroom book corners had been crowded out to make room for DORT/ a 
mastery learning system/ [that had been] randbted by a Detroit judge. 
This year most of the rooms have classroom library corners and several 
teachers have balanced the basal with literature. Many teachers are 
doing journal writing/ letter writing, and other regular writing 
programs. ..•These small in-roads came about because we [fellow 
teachers/ university researchers/ parents/ students/ etc.]. . .began to 

support each other In Fiddler on the Roof , one of Sholom 

Alechem's characters began a proposal of marriage by saying: "Can I 
ask you a political question?" "How is marriage a political 
question?/" the girl wanted to know. "Everything is a political 
questic^/" he said. Perhaps it is. But it is a perscnal question 
too. For when mandated reading programs drive literature out of the 
classroom and deny children their connection with the rest of the 
world/ then we/ as teachers/ students/ parents/ writers/ and readers 
are drawn into a political battle. We must take a stand for books and 
for children. 

While the changesf^n beliefs and in instruction which Debbie Gcodran 
manages to record in tfiis journal entry are more characteristic of sane groups 
cf reading researchers and teachers than others/ to simply state that the 
conceptual landscape in reading is changing/ is, at best, an understatement. 
Jimnry Britton (1984) calls what is happening in both research and instruction "a 
quiet revolution." The last two sentences in Debbie's journal suggest that 
while Professor Britten ray have been right in calling it a "revolution/" he ray 
have been wrong in calling it "quiet." 
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In fact, I wish to argue that nothing less than a paradiom shift is 
occurring in reading. By this I do not mean to suggest that a new paradigm is 
replacing an old paradigm. Rather, what I mean is that a new paradigm is 
evolving. In the social sciences paradigms rarely replace each other; rather 
the old and the new live side by side. 

To support my contention that a paradigm shift is occurring I will trace 
three major shifts in the assunptions which undergird recent research in 
reading. On the basis of these shifts I will outline 15 key characteristics of 
the paradigm I see evolving. I postulate that in the decade ahead teachers and 
researchers will spend most of their time sorting out one or more of the issues 
associated with the characteristics of the new paradigm. 

CHANGES IN ASSU^gTIONS AS EVIDENCE OF A P. ARADIGM SHIFT 

Thoras Xuhn (1953) suggests that revolutions in science come about as the 
result of breakdowns in intellectual systems: breakdowns that occur when old 
methods won't solve new problems. He calls the change in theory that underlies 
this kind of revolution a "paradigm shift." 

This paper argues that a paradigm shift is occurring in the field of 
reading. Because of this shift, it is an exciting and significant time to be 
involved in the field of reading. If Kuhn is right, such shifts involve 
funoamental changes in the assunptions researchers are testing relative to 
reading. 

Given the characteristics of recent research and my study of the hypotheses 
being tested by reading researchers over the past 10 years, three major trends 
can be identified. For purposes of discussion, I have labeled these trends (1) 
from transfer to transaction, (2) from submission to signification, and U) from 
convention to collaboration. These trends are overlapping and interrelated. 
They reflect, I believe, our profession's changing view of readina, language, 
and learning, respectively. ' 



From Transfer to Transaction 

Understanding the Pr ofession's Changing Views of Reading. Historically, reading 
researchers began studying reading using an inforimtion transfer view, or model, 
of reading. More recently, I am arguing, they are coming to hold a 
transactional view of reading. The shift from transfer to transaction covers a 
good deal of conceptual territory. Figure 1 describes the characteristics of 
each of the dominant views of reading conprehension. It is designed to give the 
reader a conceptual overview of the territory affected by the profession's 
changing view of reading and the roles that text, readers and neaning play in 
each view. 
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j Figure 1 

Some Characteristics of Various Views of Reading Conprehension 



Inforrtaticn Transfer 



Text 





Reader 



• Meaning is in text 

• Reading is a process of transferring meaning from text to reader 

• Key variables in this process are reading skills 

• Good readers transfer more information than poor readers 

• The criterion for judging reading success is hew much information was 
transferred 



Interaction 



Text 




Reader 



ERLC 



• Meaning is in the text and in the head of the reader 

• Reading is a process of these two meaning systems interacting 

• Key variables in this process are reading skills and text organization 

• Good readers interact with text differently than do poor readers 

• The criterion for jUu^ing reading success rests upon our knowledge of what 
strategies an ideal reader would have used given these text features and/cr 
reading conditions 

Transaction 



Ie>:c 




Render 



Meaning is relative; the result of a reacier coming in contact with a text in a 
particular context; meaning is assumed to vary across readers as well as 
within readers across settings 

Reading is a process of interpretation; it is assumed that various readers 
will give various interpretations; it is also assum&d that readers of a 
particular culture will have a shared meaning by virtue of the fact that they 
are members of the same interpretive cormiunity 

Key variables in this process are culture/ socio-historical context/ 
experience/ and the history of literacy which the reader brings to the setting 
Good readers use print to successfully e>qplore and expand their world: 
learning ought to be the criterion for judging a successful instance of 
reading ^ 
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Reading has been viewed as a process of infornBtion transfer. In the 
process of reading, inforitBtion in the text is transferred to the niind of the 
reader. Under an inforiration transfer view of reading, the text reigns supreme/ 
the reader and the reading skills of the reader are seen as being the rmjor 
variable. Good readers differ from poor readers in the amount of infornBtion 
that is transferred during the process of reading. 

Currently the most popular view of reading is what I would call 
interactional. An interactional view of reading sees the reader and the text as 
each contributing to the reading process. What knowledge and background 
experience the reader brings to the text is inportant. TextS/ however/ rray be 
either "considerate" or "inconsiderate. " Both the reader and the text are the 
focus of research. Various outcomes are expected in that no two readers and no 
twc texts are alike. Persons who hold an interactionist view of reading talk as 
if the text has a meaning independent of the reader. One of the notions they 
talk about is "dual textS/ " meaning "the text or document that was read/ " and 
"the text or meaning that was created in the head of the reader" as a function 
of reading. 

Schena Theory as Evidence of Trend. Strong evidence supporting the 
argument that a shift has occurred in fundamental assumptions relative to our 
thinking about reading — ,from transfer to interaction/ at least — is the 
recent swing to schena theory (Anderson, Spiro/ & MOTtague/ 1977: Spiro/ Bruce/ 
L Brewer/ 1980). The nurnber of studies produced during the past 10 years that 
entail a scherra-theoretic perspective is overwhelming. Because of the 
centrality afforded the reader under a schema theoretic view of reading/ one can 
even predict with some certainty which text (cohesion/ prepositional structure/ 
organizational structure/ etc) and task (functionality/ text type, lesson 
frameworks/ etc. ) variables will be studied in preference to others. For the 
most part schema theory represents a distinct shift of attention from the text 
to the reader. What readers bring to the process strongly affects what they get 
out of the process. The reader/ rather than than the text/ is center stage. 

Inferencing — ossentiallv a reader-based activity (e.g./ Rumelhart & 
Drtony/ 1977) — wins a popularity contest in terms of hypotheses currently 
being explored in the name of reading coirprehension. More studies (32) are 
coded as having a dominant focus on inferencing than on any other processing 
strategy. Most of this work looks at inferences which can be drawn from textual 
information/ and contrasts such inferences to those that can be explained only 
by positing the active involvement of the reader in the process. The dominant 
assunption is one of interaction/ i.e., the reader contributes some things, the 
text contributes some other things. Rather than looking at the reader as a 
faulty vessel that gets filled up, as information transfer theories were wont to 
dD/ the dominant view of reading today is interaction/ which Goodman (1984) 
metaphorically likens to two gears neshing — the reader and the text toudi/ but 
then both go their separate ways* 

The now paradigm I outline projects transaction rather than interaction as 
the assumption which is emerging in reading. Transaction assumes that the 
reader/ in conjunction with the text, produces "a poem/" to use Rosenblatt's 
metaphor (1978)/ which stands above the reader text plane. A transactional view 
of the reading process essentially says there is no going back (Carey, 1984). 
The product of asking a reader to try to retell everything tliat was read is a 
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new event larger than the sum of its parts (what the reac3er brought/ what was 
present in the text, and what meaning the text took on as a function of someone 
having viewed it in a particular situational context). 

In contrast to an interactional view of reading, a transactional view of 
reading sees the coming together of reader and the document read as resulting in 
a single "text" Dut this text is, to use the phrasing of the transactionalists, 
"a new event." This new event can neither be explained by examining the 
document read, nor by knowing the reader. The process of reading transforms 
both the reader and the document that was read. When transactionalists are 
shown that the document read really exists and that it physically did not 
change; they argue that this isn't true. Given different contexts, documents 
take on new meaning. Meaning, argue the transactionalists, is always a 
relationship between text — the document read — and context, and does not 
exist independent of someone's interpretation of that relationship. 

Whereas the dominant metaphor driving the study of inferencing from an 
interactional viewpoint is an "ideal reader" who would make all the necessary 
inferences to fully conprehend a text, a transactional view is interested in 
"real readers" and sees texts as open systems of meaning that vary by historical 
context as well as by the history of literacy which the reader brings to the 
reading process. (See Tompkins, 1980, for a developmental look at hew the field 
of literary criticism has changed relative to this point). 

Complexity as Evidence of Trend. In some ways the various views of reading 
sketched above parallel and reflect history. One characteristic of the trend in 
how we have viewed reading — from transfer to interaction to transaction — is 
that each view entails an ever more complex and sophisticated view of what is 
involved in reading. 

As general evidence that reading conprehension research reflects the trend 
I have talked about, I cite the fact that one of the significant characteristics 
of research published in the last ten years is its coirplexity. Because most 
studies involve multiple variables, my colleagues and I found that each 
instructional intervention, for example, needed to be coded in terms of text, 
task, reader, and processing strategy iranipulations for purposes of description. 
Many research articles these days present multiple experiments designed to sort 
out conplex rival hypotheses. Rarely are single hypothesis, straight-line cause 
and effect studies being published. In fact, in our meta-analysis data base 
U57 studies of the 573 studies synthesized), only 27% of the effect size scores 
came from studies which rade only one coirparison. Not only do most studies test 
multiple hypotheses, but most also use more than one dependent measure to assess 
tne difference between treatments. Ninety-two percent of the effect size scores 
included in the meta-analysis came from studies eirploying more than one 
dependent measure. 

Recognition of the coirplexity of the reading process is further reflected 
m the statistics used m instructional research. r^ANOVA, regression, canonical 
correlation/ and multivariate statistics typically replace T tests and analysis 
of variance. 

A transactional view necessitates a participant rather than an outsider 
view of reading as a meaning-making process (see Smith, 1984). Researchers 
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studying readers rnust assume that the reac3er has a theory o£ how and what kind 
of rneaning is appropriate given the particular circuaistances in which the 
reading process is occurring/ and further that what the reader is currently 
doing — no natter hew dysfunctional or inappropriate it nay seem to us as an 
outsider — is adaptive from the perspectve of the reader involved. It is the 
researcher's job to map this theory of meaning that is in place. 

Uncfer a transactional view, reading and reading comprehension can mean 
various things because what these activities are and what they msan rests with 
the definitions that readers give them as they engage in reading in different 
settings. In one study of first grade reading/ one of the readers involved rrade 
27 attenpts to sound out the word "hippopotemus" (Rhodes, 1979). The reader 
never did itanage his goal, but finally just went on. After the child attempted 
to retell everything that he could remember about the story / the researcher 
interviewed him in an atterrpt to understand his beliefs about reading. One of 
the questions she asked was, "Do you think you are a good reader?" The child's 
response surprised the researcher given the very hesitant reading of the story 
the child had produced/ "Yes... I try to sound out all the words." 

As is evident from this exanple/ the child's theory of reading — in that 
it excludes the notion that one has to rtake sense — is different from what we/ 
as teachers and researchers/ think of when we think of reading and reading 
conprehension. Under a transactional view of reading/ meaning \z open. While 
nerrbers of a common interpretive community will share sore meaning by virtue of 
social history/ each reader will also have his or her cwn idiosyncratic 
interpretation. In some instances, such as the example cited above, reading can 
be defined by a single first grader (or even, we have found, a group of first 
graders) to be somsthing quite different than the definition the teacher may 
have thought he or she was teaching. 

While there are not rrany research studies that have been done purely from a 
transactional point of view, several researchers began with an interactional 
view of reading and were led to a transactional view of reading in order to 
explain their data. My projection is that more and more studies will be done 
from a transactional view of reading in the future. 

One study conducted from a transactional view of reading is Galda's 
dissertational study (1982) of three readers reading various texts. Il.is study 
shews that interpretation is a function of reader more than a function of text. 
Galda studied 3 readers' interpretations of 3 texts. She found that each 
reader's personality strongly influenced how eac\ text was perceived/ what 
characters would be inportant, and what the story msant. 

Crafton (1981) sees reading as involving both text meaning and reader 
meaning. It isn't sirrply the case that readers must have the right background 
of experience in order to have a good reading experience. Reading/ Crafton 
argues, is its cwn experience. The act of reading is generative in that it 
helps learners explore, exp*^.;id/ and appreciate their world in new ways. While 
hew much background information a reader brings to the process affects what will 
transpire during reading/ not having the "right" background information does not 
preclude the reader from having a jseful and productive reading experience. 

Hayes and Tierney (1981) explored analogy as a strategy by which readers 
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might inprove their comprehension. They asked readers to recast unknown 
TOterials in terms of sbmething more familiar. They found that readers 
recasting one experience^in light of another experience (using what they knew 
about baseball to conceptualize the game of cricket)/ reported discovering 
relationships and having understandings other readers did not rtake. Analogical 
reasoning, as a reading strategy/ was cjenerative/ allowing readers to go beyond 
what they knew and what was in the text itself. 

Methodological Shifts as Evidence of Trend, Quite predictably, paralleling 
the move from interaction to transaction/ there has been a shift in research 
methodology (Carey/ 1980: Green & Bloome, 1983; Herzfeld/ 1983; Kantor, Kirby/ & 
Joetz, 1981; Mischler/ 1379), Researchers have abandoned standardized measures 
of reading in favor of multiple choice conprehension measures which more 
directly tap the cognitive operations that they are studying and which they 
suspect are not being clearly tested using a standardized reading test. Only 5% 
cf the effect size scores in the meta-analysis were generated by standardized 
measures. While there are several possible reasons why researchers may have 
turned tc other types of measures/ one pv-x3sibility is that standardized tests 
measure products of reading but do not measure what researchers think are key 
processes tc be explored m studying or understanding reading coiiprehension from 
the perspective of the new paradigm. In addition, retellings ("tell me 
everything that you can remeirber about what you have read") are much more 
frequently used to generate coiiprehension scores and subscores (24% of the time 
in our meta-analysis data)/ even if these later are broken up into idea units 
(called propositions)/ the idea units assigned to types (nain line ideas, 
qualifiers of ireiin line ideas, conjunctives between rain line ideas, etc), and 
the frequency of types subjected to statistical analysis to see if they differ 
in type as a function of one or another reading condition. 

While experimental studies, still dominate, many m:;re naturalistic studies 
are being conducted. This methodological move is further evidence of the 
paradigm shift, R^a,ther than reporting data in terms cf statistics which focus 
cn generalizable and aostract trends/ theoretical nemos which focus on concrete 
differences between treatments and which cover topics such as "friendship 
groups/" "shared cornnitment/ " and "reading as its own experience" are becoming 
mDre prevalent. Theoretical memos as a way of reporting on the research 
experience allow researchers to talk about their wn involvement in the research 
process as well as interactions and transactions that they see occurring in 
reading instruction. 

This trend m how tc report reading research has caused problems for the 
iTBjor journals in the field. While editors would like to publish articles 
reporting ethnographies of reading/ the length and style of the writing in such 
articles breaks convention. Experimental researchers on the editorial boards of 
iTCSt professional journals have nany problems with this research. To them it 
seems impressionistic. One corrective measure that one new sees is that the 
editorial boards of najor journals are being expanded to include researchers who 
nave conducted ethnographies and are sympathetic to the length and writing style 
demanded by this research tradition. This move on the part of editors is in 
Itself evidence of the paradigm shift. Editors would not change unless they 
felt that current editorial policy was against the shift in perspective 
occurring in the field of reading. 
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Similarly/ an "Erlbaum Phenonencn/ " for lack of a better terra, has 
occurred. Bode publishers, who are willing and able to publish longer pieces, 
ate coqpeting with professional journals Ly guaranteeing rapid turn-around time, 
Heiijenann, IRA, Harvard University Press, Indiana, and others have begun 
^'^tlishing -ir.traditional dissertations which essentially do not lend thernselves 
tc the statistical reduction of a professional article as was the case in a 
fcrner era. 

Ivhile the shift frau transfer to transaction is far from conplete, I cite 
the conplexity of current research and the moves to schena theory and 
ethnographi' as evidence of shifting beliefs in the field- These shifts are 
ir^rtant tc watch as the> represent a shift in basic beliefs and definitions as 
tc what is reading. Nothing could be more fundaniental or more exciting for the 
future of a discipline. 



Fron cubndssion to Sicnification 



'^^rg^tanninr the Profession's Changing Views on LanguaoeT takes both 
readers and writecs to create a revolution. Language in use — 
speaking/listening, writing/reading — is a form of social action. The 
ocpcrtunity tc standardize language — to nake one's own dialect the "stantferd" 
dialect — is an instance of social and political pcwer. 

Lver since the invention of the printing press there has been a tendency to 
want tc freeze language, that is, standardize its spelling, its grammar, and 
ctr.er aspects cf fcrm. Often this trend is couched as being notivated by the 
desire tc facilitate coimiunication among and across various readerships of a 
language. 7oday English contains many silent letters * hich in a former era were 
proncunced, i.e., "knight," "gnat," etc. 

Zne way tc cc^coptualize the changing trend in how wt. view language is to 
see thaty with the advent of printing, language became an cbject of stu^ in and 
cf itself. Linguists shifted their attention from oral lanyjcge (which of 
ccurse varied from language group to language group) to writttJi language. 
Written language was a better medium to study because with the advent of the 
printing press it had beco.ie *nore stable. The result of this work led linguists 
tc identify the rules of hcM language worked. They concluded that it was hignly 
si's ten^ tic and organized. Sentences which followed these rules were deemed 
jrantratical. The linguist Noam Chomsky did more than anyone else to map the 
r-Ies cf language, and in fact developed a "transforirational gramrrar" which 
atten^ted to explain how language worked. If an utterance didi't follow these 
rxiles, it was considered "ungramnatical" or "wrong." "Correct" English was 
English that followed the rules of transformational gramrrar* Onoe these rules 
*,crc developed for written language they were used to judge the gramtraticality 
cf cral language utterances. 

The fact that most oral language and a good many of the newer written 
language changes were by these rules "ungrammatical" began to bother many 
pecple. These linguists argued that a theory of language that did not explain 
"language in use** was no theory at all. 
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When these lin-guists went to study language as it was being used by 
storekeepers, street people/ workers, and others, one of the things that they 
found was that language was extremely corrplex. In fact they found that the 
ineaning cf an^ utterance could not be totally understood by just studying the 
language or wording of the utterance. In order to nap the meaning of an 
utterance/ linguists had to take into account nonverbal aspects of the event 
such as gesture/ situational context/ shared knowledge, and other types of 
cornmunication systens that might be present. These linguists began to talk 
about language as the act of signifying ineanings with a variety of signs* Scene 
meaning in a language event could be assuned. Some rneaning could be assigned to 
context. Some meaning could be allocated to gesture. Sane meanings could be 
assigned to language. These linguists tjecame interested in the process by which 
groups cf people decide tc agree that such-end-:such gesturer such-iand-^uch a 
word/ etc./ will mean such-end-such. They refer to this process of hew groups 
ccilaboratively learn to mean as the process of signification. They see 
understanding this process as central tc understanding the process of literacy 
and literacy learning. 

This change/ however/ has been recent. Under ei^ier a national 
preservaticnal or Chcnskian view of language/ as might be expected/ language 
cecame restrictive. Children weri taught the rules of "proper" English. A good 
sr^are of English time in schoclG was spent attempting tc get children to abandon 
^ngranratical forms they had picked up from their home or community. Language/ 
ratner than oeing viewed as an ever-changing/ ever-irelleable tool to be shaped 

tne language user/ became something apart/ something one was suppose to do 
"correctly" or not at all- i'Jhile most speakers found that they had to "submit" 
tc proper English — that is give up some of their preferred oral language forms 
in order tc be successful in school — this view was particularly hard on 
oialect speakers. Given the nunber of changes they were asked tc nake in order 
for their English to be declared "standard/" it was difficult for them not to 
feel tr.at the English the^- spoke was "wrong" and that their parents/ by teaching 
then this English/ were not good Americans. 

A second major shift in assuirptions underlying research in reading 
cent: rehens ion relates tc tnese cnanges in the profession's view of language. I 
cccisidered labeling tnis trend "from authority to authorship/" but rejected that 
label because it fails tc capture a growing recognition of the rrultimodal 
3imensions of lar^guage m use. Language has been viewed by proponents of the 
old paradigrr* as a closed system/ something one submits to, something to be 
policed, in terms cf ocnprehension/ the attitude has been that words are a key 
meaningful unit cf languaqe and that reading is a process of chaining the 
stancBrd meaning of Englioh words together. Paralleling this belief was the 
333un5^tion that if a reader could pro£^tly pronounce words he or she could read 
— m the sense of ocitprehend — and that reading (associating particular 
neanin^^s to wcrds) -v-ould renisin constant fcr the indivi<^al across time (from 
childhood tc adulthcc<J;. A good index to the difference between a proficient 
anv^ a net so proficient reader/ by this view, was the si^e of a reader's sight 
♦xcabular>^. 

Irder the Sjiris^im view, reading was seen as a skill which needed to be 
practiced to bo perfected. Deviations from text were not tc tolerated. 
.Wadingi for the most i^rt/ was vie*;ei as a restrictive process, even more so 
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than language genera lly# because it was thought to involve a second-orcier 
abstraction over and above oral language processes liKe listening and speaking. 
Oral language was easy# written lanuua^ was hard. The difference between 
learning tc use written language as C[:^sed to oral language was a process of 
decontextualizatioc: that is# readers and writers must learn to attend tc cues 
within language proper rather than naXing use of the supportive contextual cues 
as they did when learning to talk and listen. Writing instruction was delayed 
until after the language learner had learned how to read, as reading was seen as 
a prerequisite tc writing. Reading conprehension was seen as the end result of 
readinj. Reading was best taught fa^- working on lower-level skills like decoding 
and word recognition initially, bringing these to automaticity, and via this 
process freeing the inind tc attend tc meaning or higher-level processing skills. 

Today a submission view of reading is being held by fewer and fewer 
specialists in the area of early reading, though it is still quite prevalant in 
content area reading where it is often assumed that there is a body of 
infornation that needs to be transferred and that therefore the model is nore 
viable at this level. Even here, however, the dominant view is changing. 
Because the facts that schools taught — J^ewtcn's laws: atoms are the srrallest 
things in the universe: etc. — have been found faulty, nany content area 
specialists tocby believe that the focus of study in their discipline should be 
upon "process." They advocate that study in their discipline should focus on 
hov the process of science works, not on the particular content or "facts" that 
process generates at a particular moment in time. Science they argue proceeds 
on the basis of belief/ not fact. Belief often looks like "factf" but is 
essentially thought at rest. They advocate developing critical readers who 
question fundamental assumptions while reading and actively use reading and 
writing to test out hypctheses in order to grow. 

Early Evidence of the Trend. The individualized and language experience 
approaches to reading {see Van Allen, 1376}, advocated in the two decades prior 
tc this research study/ strongly challenged the assumptions underlying a 
subnission view of language. More recently, but still also a c^cade prior to 
the focus of this review, !riscue analysis {Goodnan/ 197C) and instructional 
cloze *Borr«uth, 13L1) were attempts tc recognize that reading was an instance of 
language in use and hence more open and amenable to variation than the 
predominant view. Miscues were defined as observed responses which differed 
from expected responses in text {Goodran & Burke/ 1980). Omissions, 
substitutions, and insertions which did not change the meaning of the text were 
coisidered reading strengths, as cj^xjsed to weaknesses, in that they showed 
evidence of the reader actively applying what it was he or she knew about 
language and the world. The cloze procedure/ in which readers are asked to fill 
in every nth word in a passage/ was initially scored using the text's surface 
structure as a tenplate. With the move from testing to instruction, the 
developers of cloze suggested that the criterion in scoring ought tc be relaxed 
and that any and ail words whidi nake sense given the context of the sentence 
and text be scored as correct, j^aze ( Juthrie, 1977: Guthrie et. al. , 1974), a 
cloze-like procedjre in whidi readers select 1 of 3 cjjticns whenever they *each 
certain points in the text, can be designed to check cn the reader's flexible* 
use cf various cue .systera Cgraphcphcnoir^iC/ syntactic/ semntic, or ccntjinations 
cf these) as he cr she is reading. Each of these tren.I^ was an infj-licit 
recccniticn of "the openness of language." 
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Khen language is seen as "closed/** one {and only one) neaning is 
acceptable. To say that language is "open" is to recognize the fact that while 
merrbers of a language cofiminity share some meaning* each individual has his or 
her cwn meaning for a given word. The word "tree#" for e^nple, ireans something 
different to you than it does to other meirbers of your language coninunity. 
Sifrilarly "tree" means one thing to a 3-year old# something quite different for 
the student wJa. has studied the function trees played in the Westward Movement* 
and something different even from both these meanings to the city slicker who 
moved to the country to get away from the city. This does not mean that meirbers 
of the same interpretive coimrunity do not share some meanings* but rather it is 
an attenpt to recognize that language is forever changing. ^Tociiy words like 
"gay*" "petting*" and "cool" have a different meaning than they did at earlier 
points in our history. Paralleling these insights into language* meaning* 
rather than word calling, became the focus of reading researcii. 

Reader-Sased studies as Evidence of Trend. During the past ten years this 
trend has continjied. In fact, the trend that one sees is a move ever further 
and further away from the surface of the text. Miscue and cloze research, while 
meaning based* are very close to the text. Inferencing is more reader based and 
moves the study of meaning away from the surface features of the text to the 
process by which the reader constructs meaning* or makes a unified sense* out of 
nis of her reading. Macro-operators are rules of generalization and deletion 
which readers systenatically apply to reduce text (Kintsch & van Dijk, 1978). 
Story grammars {Rumelhart, 1977; Stein & Glenn, 1978; Thorndyke, 1977) are 
mental structures which readers have intuitively discovered as the 
crcanizaticxial conponents of a well-formed story. If* for exairple, a setting or 
an attenpt is not present in a story read, the reader is likely to add this 
category when asked to retell the story after reading. Macrostructures and 
story gramnars are not* in a true sense, in the text at all* but rather are a 
pnenomenon in the head of the reader. Metaphorically the trend has been for 
researchers to step further and further away from the text or document read in 
tneir attenpts to understand and study Key cognitive processes in coqprehension. 

Clearly the bulk of the research today is on inferencing or the study of 
cc^rprehension as a function of reader-text interactions, but the larger trend — 
tne study of comprehension in teniG of the cognitive strategies that the reader 
uses to reduce and store meaning — is in place. Many researchers studying 
instruction* for exanple* are developing programs which help readers learn and 
apf»ly the necro-operators or strategies readers use to reduce and store 
mforiTBticn in merrcry. To date these studies are text-dependent, though there 
IS some indication that researdiers are beginning to map strategies successful 
readers use across a variety of contexts. Other researchers are developing 
prcgraiTfi which teach children conprehension monitoring strategies. Many of 
these programs atterrpt to get children to be consciously aware of these 
strategies. In some programs cJiildren are taught to ask themselves, "Did what I 
read nake sense?," "Did what I read scund like language?" If the answers to 
these juestions are positive, the reader is taught lo continue reading. If 
either question is answered m the netjative* the reader is taught tc go back and 
reread. 

Interdisciplinary Studies as Evidence of Trend. Not surprisingly, 
interdisciplinary study has resulted from this l^roacfer conception of reading. 
Tc<iay almost all instructional studies in reading o^nprehension borrow freely 
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from cognitive psychology and linguistics. Many others — and these tend to 
fall out in canps (it is fascinating to see who quotes whan) — borrow from 
sociolinguistics. Some borrow from literary criticism. Few borrow from more 
than one discipline at a tine, though this too is changing, Bruce (1979), for 
exanple/ freely borrows from linguistics/ cognitive psydiology and 
sociolinguistics. Feathers (1984; has recently conpleted a dissertation using 
perspectives rooted in linguistics/ literary criticism/ cognitive psychology* 
sociolinguistics/ and reader response theory. While most studies are 
irultidisciplinary rather than truly interdisciplinary/ this trend too is 
changing. 

One very healthy change has been a clear attenpt by nore re^searchers to 
trace the roots of their thinking back in time. References to JameS/ Peiroe/ 
Dewey/ Huey/ Rosenblatt/ Jakobson/ Vygctsky/ Piaget, and others abound. What is 
encouraging is the recenc attempt tc trace as well as irep the history of thought 
underlying both the old and new paradigms, 

Readinq/Writinq Relationships as Evidence of Trend, The hottest thing in 
reading/ however, is writing, Pearson & Tiemey (1984) have argued that in 
terms of what the mind doeS/ reading and writing bear much in common, Reading, 
ratner than being seen as a process of reconstruction/ is seen as a process of 
construction. The reader doesn't reconstruct the author's message: the reader 
constructs his or her own message. Shanklin (1982) has proposed a transactional 
view of the writing process using multidisciplinary work in reading and language 
as a metaphor for exploring key psychological and sociological strategies 
involTOd in reading and writing. 

tiansen and Graves (1984) have been actively working in classroons exploring 
reading and writing relationships. Frcxn a constructivist perspective, both 
reading and writing involve composing. What is of particular interest is the 
social process by whi<di objects like print are taken as signs which have the 
potential tc mean and become a communicative convention for a group of language 
users. 

In an interesting mix of reading/ writing, and coirprehension/ Rosen (1985) 
and >fells (1985) recently reported working with readers using a technique they 
call "storying across the curriculum," In the videotape footage I saw/ children 
were involved in a social studies unit. Once a selection was read, children 
were encouraged to create their own personal stcary of what they thought the 
selection meant. From group discussion this activity led tc writing personal 
narratives in which the children were asked to put themselves in tf.e time frams 
being studied and retell history from the viewpoint of the characters they 
developed. While this data is just new being analyzed, the personal involvement 
and the depth of understanding displayed by the children on videotaije was 
exciting. I strongly recoimend that readers follow this work closely. 

An Expanded Definition of Literacy as Evidence o£ Trend , While tGxt3 were 
initially seen as meaningful configurations of language intended to communicate 
U'G Beaugrande, 1980), they are now being seen as meaningful configurations of 
signs intended to communicate (Siegel, 1983). Re^searchers began b^^ neipping 
languajie structures in text. Today they are mapping language and nonlang^jagc 
systems like how pictures, graphs, charts, and other aspects of fcrnat 
ccntrit«te to and, together with print, sign the meaning of the text. This lia^ 
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led to new interest and insights into the nanner in which illustrations and 
other textual devices semantically support and facilitate text conprehension. 

De Seaugrande (1981) identifies 7 key characteristics of text which not 
only acply to the texts we read/ but also to the texts we write: cohesion, 
coherence, intentionality, acceptability, situationality, intertextuality, and 
mformativity. Fran De Beaugrande, it is a short step from this notion to the 
assuitption that these characteristics are strategies (search for a unified 
neanmg, never -assume nonsense, make the text you create fit the context you are 
m, etc.) tnat successful readers and writers use in text interpretation and 
production. 

Strategies such as these have as much to do with learning as th^ do with 
reading. is not not surprising, therefore, that reading and writing in a 
systen^ of knowing become topics of exploration (see Harste & Mikulecky, 1984). 
The issue Decomes, "How and in what ways are the reading and writing processes 
similar or different from the learning process?" The multimodal nature of text 
production and conprehension gets renewed enphasis (Harste, Woodward, & Burke, 
1984: Sadoski, 1983, 1984; Siegel, 1983). Sadoski and Getz (in process) study 
mental imagery as a semantic system in its cwn right that operates in 
conjunction with written discourse or print but which facilitates the reader's 
attenpt to create a unified meaning and plays new cognitive roles in 
conprehension. Siegel (1984) asks readers to draw a picture of w^-^l the story 
neant to tnem. She sees the process in whidi these readers are engaged, not as 
a sinple moving of inforiraticn from one communication system to another/ but 
rather as a recasting of their knowing, and this very process of projecting 
meaning on a new content and expressicxi plane as what real literacy and its 
study is all about. 

In sone ways the trend from submission to significaticn is a trend from 
seeing reading as an independent freestanding skill to seeing reading as a 
process of learning within a system of knowing. Figure 2 conceptualizes the 
process of readma withm the process of learning. Tocby, researchers studying 
reading conprehension are suggesting that teachers present reading to children 
as one of several process tools learners have available to them for transforming 
what they know and what they currently believe. Writing, peaking, listening, 
art, music, matheratics, and dance are seen as other processes or tools which 
are available. Reading, they suggest, should be presented to children as a 
\'ehicle by which learners reperceive, reassess, rethink who they are and what 
they believe in their coming to know. As a function of involvement in the 
reading prccess, learners are different than they were when they initiated the 
process. 
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Figure 2 
Reading in the Learning Prcx:ess 




RtaJiKC 



This shift from subndssion to signification represents a significant change 
m the profession's view of language* This shift has inportant implications for 
instruction. Rather than teach children to perfect reading as a skill so that 
they might carry it around and use it "appropriately" as the time arises/ 
reading is seen as valuable only when in use. One doesn't learn hew to read and 
then read to learn. The focus of reading instruction/ these educators argue^ 
ought to be upon learning/ not reading per se. Children/ right from day one/ 
should be involved with books. Reading and writing should be presented 
"naturally" as children continue to explore new worlds. 

Initial moves in viewing language as a process of signification began when 
readin9 educators advocated integrated language arts programs (essentially 
parallel play in which the skill taught in reading could also be taught in 
writing/ speaking/ and listening). Today the emphasis is on fusing reading and 
writing across the curriculum/ and the abandonment of a fragmsnted curriculum, 
we trace the onset of this change in cur view of language — f rc^ submission to 
signification — as having begun with the language experience and individualized 
reading movements in reading. Major indices of this trend have been miscue 
analysis/ instructional cloze/ reading/writing connections/ and a renewed 
interest in mental inagery and the multimodal nature of literacy use and 
learning. 



From Convention to Collaboration 

Understanding the Profession's rhanging Views on Language Learning. The third 
major shift xn basic assumptions in reading research is best characterized as 
one moving from convention to collaboration. Whereas the shift from transfer to 
transaction refers to changes in assumptions relative to reading/ and the shift 
from submission to signification refers to changes in assumptions relative to 
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language/ the shift from convention to collaboraticn is meant to capture a basic 
shift in the profession's view of learning. 

Specifically/ this trend is a shift in hew we view language learrdng; from 
language learning as acquisition to language learning as evolution. If, for 
exanple/ language could be frozen and the rules mapped/ then the process of 
language learning would be a matter of siirply picking up or acquiring the 
language that is' already in place. Under this view, the role of the language 
user is seen as passive. The learner doesn't change the language: his or her 
job is to adapt to the system that is already in place. 

There are, however, alternatives to this view of language learning. I am 
arguing, m fact, that the shift in the profession is away from viewing language 
learning as a passive activity to a more active orie. 

Rather than seeing language learning as simply a matter of acquiescing to 
the conventions of language, the current view is one of collaboration . Each 
lanouage learner has to learn language from the inside out. While clearly the 
language spoken in the language user's interpretive community is the language 
learned, each language learner has to reinvent the rules of language for him or 
herself in the process of learning language. When this view is applied to 
reading, it means that no one can tell another reader how to read. The reader 
has to'invent or reinvent the rules him or herself. Up to this point, the 
process does not appear collaborative. 

But, of course, language learners are not on their own in this process. 
Ttisy can attend to some aspect of language that interests them, forirwlate an 
hypothesis, test it cut, and then get fee(±>ack from other language users as to 
whether or not the hypothesis was tenable. If the young child, for exanple, 
thinks he hears his mother say to his father/ "Get me some' coffee, " and his 
father gets up and puts the dog out, he knows he's made a mistake. No one has 
to tell him. The social context and his social involverent with other language 
users is all the feedback he needs {Smith, 1980). Up to this point, however, 
the process iray appear to be more one of social coercion than oollaboration. 

To view language learning as collaboration is to see language learning as a 
socic-psycholinguistic process. Psychol ingu is tics is the study of cognitive 
strategies that individuals enploy in learning and using language. 
Socio-psycholinguistics (by placing socio first) accents the social nature of 
the language learning process. Under a socio-psycholinguistic view of language 
learning, the learner is seen as active. Not only do language learners rrake 
lamguage their own, but in this process they endow language with their own 
birthmarks* Each of us, for example, have our own pet phrases, our own pet 
idiosi'ncracies, cur own peculiar use of words. Because of the social nature of 
languace, sore of these idiosyncracies get picked up, and the original meaning 
of the "word is expanded. There are always two forces at work in language. One 
IS towards convention — reaning nQintenance: the other towards expansion — 
rreaning generation. Both processes, however, involve groups of language users 
and collaboration among and between the members of the group. 

"O-Meat" in cur house means bologna- We never use the word "bologna/" 
though it is one of xtr^ son's favorite sandwich meats. In fact it was his 
calling bolocjna "LH.':eat" when he was very young, and convincing us that it was a 
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better term than bologna/ that resulted in its use by nient>ers of our family, 
ViJhether or not the term will catch on in an ever-expanded interpretive cornnunity 
renains tc be seen, though at this point our son has managed to get some of his 
friends to use the term, 

V?hile all three of the trends — from transfer to transaction, from 
submission tc signification, from convention to collaboration — are moves away 
from subject/object dualism (i.e., looking at language as if it exists apart 
from use)/ the abstraction of language and hence its reification is the problem 
accented by this trend. Convention is seen as fact, something inherent in 
language itself, something given, something outside and above any particular 
interpretive coimiunity of language users (see Fish, 1980). It has become sort 
of a free-floating standard. Concepts such as "correctness, " "appropriateness, " 
and even to some degree "proficiency" and "conpetency" reference anchor points 
in the "ideal" rather than the "real" language user (Halliday & Hasan, 1980). 
In order tc talk about language using these terms, the speaker needs to see him 
or herself above it all. These are "outsider" rather than "insider" views of 
language learning. 

Under the convention view of language learning, growth and development in 
language was equated with growth and development toward convention. 
Conventions, or stancferd forms — rather than the collaborative process by which 
conventions arise and are rraintained — were seen as fixed. The tenacity of 
this position is still quite evident, as most developmental continua in 
language, even today, end with conventional control. That is, while a lot of 
researcliers studying language learning say they are interested in studying the 
process, they use product measures like "correctness" as their criterion to 
judge grwth. 

Changes in Evaluation as Evidence of Trend. Interestingly, until recently, 
convention was the gcal and evaluative standard used to judge and identify a 
good process language arts curricula, too. To be theoretically consistent, 
however, process approaches tc language learning ought to focus on hew readers 
and writers collaborate to support each other in the learning process and rest 
their case on these grounds. Having provided children opportunities to 
experience, see demonstrated, and come to value strategies whereby they might 
use print (reading and writing) as process tools for learning ought to be the 
evaluative criteria by which a process approach to reading and writing is 
judged. To use the acquistion of convention as their yardstick is to mix apples 
and oranges. 

Similarly classroorro cannot be coq^ared against a single instructional 
criterion or conventional standard. Classrooms are groups of language learners. 
In some of these classrooms children — even severely labeled children — 
achieve. In other classrooms children do not- Rather than ask which behaviors 
by teachers are positively correlated with student gains on tests of 
achievement, the new conprehension researcher is asking questions of 
collaboration, "How is it that it can make sense to students to learn in one 
situation and not m another? What are the teacher and students doing 
differently? How are these meaning systems created and sustained in daily 
interaction? What does reading conprehension mean in this classroom as opposed 
to other classrooms and hew do these def initions-in-use relate to morale and 
what we see as the goals of reading and reading instruction?" 
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In reality, evaluation is a frontier yet to be c 3equater/ acjressed by 
advocates of a' process approach to reading. While those in the vanguard taLc a 
SSSnp^ro^ch to reading and learning, their choice of dependent measures 
JSlectst'lorthe nost par?, some aspect of convention Hcvever, there has been 
a reSnt effort to define the language arts in terms of sociolinguxstic and 
nosological strategies rather than skills. The effectiveness of instructional 
?^terveSions is beginning to n«asured in terms of the Julia's use of reading 
strategies (self-correcticn, self -monitoring, meaning maintenance) rather than 
in terms of correctness, though these are often hopelessly confused in some 
research studies. While the definition of "strategy" has not yet been fully 
specified, it seemingly involves (1) choice on the part of the language user in 
terms of when it will actually be applied, (2) conscious awareness, and (3) 
altemati^which are both psychological (that is, things language "sers can 
coqnitively do by themselves such as monitor meaning) and sociological (things 
language users can collaboratively do together such as say something about what 
they have nade of what they have read to each other). 

Convention is not, by the way, unimportant in a process view of language 
learning. Rather than the goal, however, convention is seen as a "ringe benefit 
of involvement in the process of language use and learning. 

£:.panded Print-Settings as Evidence of Trend. Although correctness and 
ccnvention are in no iitmediate danger of being abandoned as the sine qua non of 
literacy, there is sone evidence that change is underway. From a collaborative 
view of languaae learning, conventions are negotiated and, hence, are dependent 
upon the circumstances of use. The ability to read does not involve a fixed 
sinale skill or ability, bu- rather a set of negotiated strategies and 
assGnptions which, in their specific detail, vary by the circumstances of^use 
(Kucer, 1932). The strategies used to read narrative text are dii.i.erent i-rom 
those used to read expository text. Learning to read means learning to use 
soecific strategies for specific contexts under specific conditions. Reading 
is not a single, huge, nonolithic skill which once mastered can be applied to 
all contexts. Researchers tocBy are testing hypotheses which suggest that 
reading conprehension would be inproved with opportunities to explore various 
contexts of literacy. Direct reading instruction in reading expository texts, 
n=»rrative texts, poetr^, reference iraterials, and the like, have replaced the 
transfer of learning assurrpticn which was in place in the days when only story 
raterials were used as the basis of reading instruction. 

The first evidence of a shift in major assurrptioos relative to language 
learning probably beoan with developmental psycholinguistics (see Lmfors, 1980, 
for an excellent review}. Child language was seen not as a nutant form cf adult 
lan<niage, but a svstem unto itself, having its own rules and internal 
ccnsistencies. Dialect studies in the 60' s brought new respect for dialect 
speakers and demonstrated that dialects were language in the sense that they too 
had a structure that nade sense internally. Outsiders might look at dialect as 
"incorrect" or "Md" English, but the view from the inside was that it was a 
trje languaae with its own internal structure and rules. 

^'cre recently researchers have shifted their attention from oral language 
tc written lanquaoe learning (Baghban, 1984; Clay, 1972, 1975; Fenreiro S 
Teberosky, 1^82: Heibert, 1973, 1991: Mason, 1980; Sulzby, 1981; Teale, 1:J78, 
1?82). written language is seen aa varying by the circumstances of language use 
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(DeFord, 1980: Dyson, 1984; Heath, 1983: Taylor/ 1983). As a result there is 
renewed interest among researchers in how reading differs across school and 
nonschool settings {see Harste & Mikulecky, 1984/ for a review). While 
narrative and expository texts are the focus of much comprehension research in 
reading/ predictable books (Rhodes/ 1979), journals (Staton, 1980; Vargus/ 
1982), job rtBterials (Mikulecky & Di^l, 1980)/ governmental forms (Redish/ 
1981), and environmental print (Goodman & Goodman/ 1979: Harste/ Woodvard/ & 
Burke, 1984; Keibert, 1978/ 1981) have commanded some attention as alternate 
contexts of literacy worthy of study. Children are said to have gained access 
to written language long before their reading and writing can be deemed 
conventional (Harste/ Woodward/ & Burke/ 1984). Meaning is a collaborative 
process. Conventions are the result/ not the focus of language learning. 
Meaning, rather than convention/ is the place where readers and writers maet 
(see Smith, 1982, for an opposite view). 

Renewed Interest in Groups as Evidence of the Trend . Language learning 
interests such as this have led to renewed interest in context and the social 
nature of knowing (Brandt, 1984: Carey, Harste, & Smith, 1981). Learning to 
read now means learning how to negotiate meaning collaboratively in a particular 
instance of written language use. Reading is an event which entails an ongoing 
collaborative process of social sense-making. Reading is only one of several 
languacje processes — though accented and highlighted — which are available to 
language learners in the event we call "reading." Meaning is negotiated among 
the participants in the setting and evolves over the course of the event itself. 
As a function of experience, the reading experience is constantly evolving as is 
the criterion for what constitutes successful reading. There is no point at 
which we suddenly learr. to read: rather/ each of us continually evolve as 
readers. There is no point at which we suddenly are successful readers: rather, 
each reading is best seen as adaptive given the reader's view of what 
constraints and choices were available in this situation. (In some classrooms 
sounding out words is adaptive: in others/ it clearly is not.) 

As a result of such thinking/ an instance of reading is labeled a. "literacy 
event" rather than as an act of reading (Teale/ 1978). Writers/ reportedly, 
spend as much time reading during writing as they do writing (Atwell, 1980). 
Things previously considered disruptions/ that is, residing outside of the event 
(like talking with one's neighbor about what one is reading or relating a 
personal experience)/ are no longer considered unirfportant (Y. Goodman/ 1984). 
Shifts and moves among and between alternate communication systems during the 
reading event — from reading, to sketching/ to talking/ back to reading — are 
opportunities for readers to shift their stance relative to the text 
psychologically and sociologically andU in this process, recast and triangulate 
their knowing (Siegel/ 1383). The very coirplexity of a reading event is said to 
support the reading process both psychologically and sociologically. 

Every instance of reading is seen as social: as a collaboration inplicitl/ 
or explicitly involving an "allowability contract" (Tierney & LaZansky, 1980). 
Social theories of reading augment schem-theoretic approaches (Bcuce, 1973). 
Groups and group processes play a new critical role in helping us undersldud 
literacy use and learning (Bleich/ 1984). Classroons are social units and 
referred to as "cultures of literacy" (Bloome & Green/ 1982). Logically/ the 
research outcome is a renewed interest in hew teacher beliefs, expectant ios, and 
c^haviors affect student perceptions of the process (DoFcrd, T^Bl). 
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Renewed Interest in Learning and Curriculum as Evidence of Trend, Calls 
are nade for more classrooru-based research (Green & Bloome/ 1983)/ less 
curricular f ragroentatia , and theories of learning which incorporate what we 
know about the social nature of learning (see Harste & Jurewicz, 1985: Harste, 
Mitchell-Pierce/ & Cairney/ 1985). The real frustration for nany of the 
researchers advocating the new paradigm is not The Nation at Risk (National 
Commission on Excellence in Education/ 1983) report itself — this was 
understandfeible — but rather their own colleagues' capitulation to the report. 
Advocates of the old paradigiri respond by discussing wore effective ways to reach 
old goals/ while advocates of the new paradigm want the profession to focus upon 
new goals for reading and reading instruction based on evolving insights. 

The upshot of all of these trends is a renewed interest in learning and 
curriculum (Eisner, 1982: Mitchell-Pierce, in process: Short, in process). 
Rather than focusing on reading per se, there is a growing interest in the role 
that reading plays in a system of learning. The reading event is a learning 
cycle having self --corrective devices built into the process itself (Scibior, 
1984). Educators are reminded that in the final analysis their interest in 
reading and writing is an interest in learning (see Y. Goodman in Harste & 
Jurewicz, 1985). Reading and writing across the curriculum becomes a logical 
movement m that it accents learning and the process of learning. Reading is 
conceived of as authoring and the process of authoring as one of coming to know 
or learning. Authoring, in both reading and writing, is posed as a learning 
cycle that occurs across time. The teacher's role becomes one of support, of 
helping children shift perspectives (sk. - Shanklin in Harste & Jurewicz, 1985) 
and thus take multiple perspectives on what they know and in this way learn. 
Reading and writing are seen as two instances of hcM readers might shift their 
perspectives during this learning cycle. The social nature of all learning, but 
particularly of language learning, is errphasized (Halliday, 1978). Teachers are 
asked to set up their classrooms so that children have opportunities to 
experience, see demonstrated, and come to value the strategies associated with 
successful written language use and learning (see Harste ^ Jurewicz, 1985). 

Practical Theory as Evidence of Trend . Paralleling this change is a 
renewed interest m classroom-based, ethnographically-oriented research studies. 
The trend today, regardless of paradigm, is for extended involvement and 
urograms of stud^' rather than isolated studies. Examr.ies wculd be Pearson and 
his colleagues' work on inferencing (Gordon, 1979: H?.nsen, 1979, 1981: Pearson, 
Hansen, Gordon, 157^: Raphael, 1980: Raphael, V?inograd, & Pearson, 1980: Taylor, 
1962) and Brown and her colleagues' work on coirprehension monitoring (Brown, 
1581, 1982: Brown £r Day, 1983: Brown, Day, Jones, 1983: Brown & Smiley, 1977, 
1978: Brown, et. al, 1983). On the whole, programs of research such oS these 
seem to have a more lasting influence on subsequent research and practice than 
do one shot efforts. Teachers and researchers are collaboratively studying 
proDlems of raatual interest (Pierce, 1984: Mitchell-Pierce, in process: Short, 
in process). The teacher's curriculum is as much a concern as is the child's 
curriculum. Teachers are asked to be researchers and researchers to be 
tochers. Both the National Council of Teachers of English and the 
International Reading Asstxiiation have established snail grants programs which 
encourage teachers and rer.earchers to work collaboratively together on problems 
of mutual interest. Movenents which started as calls to move theory tc practice 
have teen replaced with calls to develop practical theory. 
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The emphasis is upon the developmsnt of theory based on lancpjage in use 
(Hallicfey & Hasan/ 1980: Herzfeld/ 1983). Rather than bringing theory to an 
atheoretical horJe/ teachers and children are seen as having adaptive theories 
that are the result of a negotiated meaning in this context (Smith/ 1984), 
Historically/ Goodran (see Gollasch/ 1982a/ 1982b) and Graves {1983)/ who both 
developed process models of reading and writing/ will probably not be kncwn for 
their models of reading and writing/ but for having started a movement towards 
practical theory in their respective disciplines. The upshot of this trend is 
that the traditional gap between research and practice is not inevitable/ but 
rather as a function of the old paradigm. 

Studies such as Pierce's (1984) in which she went to work with two first 
grade teachers in an attenpt to explore the instructional inplications of what 
is currently known about language and language learning/ are indicative of 
collaboration and the trend. Recently Hansen and Graves (1984)/ well-known 
researchers in the areas of reading and writing/ have joined with teachers in 
exploring collaboratively a process approach to the teaching of both reading and 
writing in classrooms. Kucer (1982) won NCTE's Promising Researcher Award for 
liis aLtenpts to develop a theoretically-based curriculum juxtaposing reading and 
writing. 

Despite the fact that some expjerimental ^lesearchers do not see such studies 
as "hard science/ " I predict that the trend tcwards studying language in use — 
be it reading coirprehension/ writing/ the evolution of literacy, whatever — 
will continue. The one thing Graves and other researchers have taught the 
profession is that by moving from the laboratory to the field/ gaps between 
theory- and practice are lessened and teachers see how they can use research to 
inform practice. Graves's most recent research report is approaching sales of 
iX/OOC copies. Whether the researcher coimunity likes his research or not, he 
cormands a huge audience. Teachers understand his work and come to listen. 
Without a teacher following/ educational researchers have few educators to talk 
tO/ regardless of the quality or inportance of their work. I predict/ 
therefore/ that the trend towards practical theory will continue/ as will the 
trend towards a new methodology for conducting educational inquiry. This trend 
will win for pragnatic purposes because teachers understand it and know what to 
make of it, if not initially for academic ones. The result will be a 
mfethodclogy that takes into account the unique/ action-oriented demands of doing 
educational research. 

While experimental research has been under attack (see Erickscri/ 1985)/ so 
nas ethnography. An ethnographic approach focuses on description rather than on 
action. Educators must act, they cannot wait until all the data are in. 
Collaborative research paradigms are being developed (Smith/ 1984: Stevens, 
1985) which not only describe what is, but which attempt to intervene in the 
process and thus explore what is [x^ssible given changes in classrooms and 
teaching. 
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CHARACTERISTICS OF THE NEW PARADIGM 



Figure 3 

Characteristics of the New Paradigm 
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Envisioning the new paradigm that is evolving is important. Figure 3 presents 
15 key sets of terms contrasting the old and the new paradigm. Advocates of 
both the old and the new paradigm have difficulty with these terms as the 
scientific function of these terms is to redefine — if not often "de-define" — 
conceptual ground thought understood. The intent of this paper is to provide a 
state-of-the-art assessnent of reading research for purposes of predicting the 
future. Since I have decided that the best way to do that is by tracing the 
evolution of a new paradigm, following are some statements describing my 
inpression of its current characteristics and the "buzz words" being used to set 
this paradigm apeTrt from its predecessor: 

1. STRATEGIES — It focuses on process/ defining reading in terms of 
psycholinguistic and sociolinguistic strategies/ and suggests that the 
content of instruction be the strategies of successful language use and 
learning as they relate to reading. Vocabulary and correctness/ while 
inportant/ are not the content of instructicffi. The difference between a 
skill and a strategy still needs further clarif icaticxi. 

2. SUPPORT — It views reading as a disciplined/ creative activity that can be 
analyzed/ described/ and supported by creating instructional contexts in 
which the strategies of successful language use and learning can be 
experienced/ demonstrated and valued. While the difference between 
intervention and support needs farther clarification/ it is presently being 
suggested that interventidn^ is to a psychological model of learning as 
support is to a sociological model of learning. If language and knowledge 
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are socially constitated/ then understanding hew it is that language users 
socially support each other in the reading process is a priority agendb^ 

TRAI^SACnON It enphasizes that reading is a way of learning and 
oeveloping as well as comnunicating what has alrea^- been learned. Reading 
is seen as a process by which readers outgrow their current selves. Rather 
than viewing reading as a process of infornation transfer with the irajor 
x-ariable being a faulty reader* transaction sees the coming together of text 
and reader as an open potential ever changing as a function of the context 
of situation and the history of literacy brought to the setting by the 
language user. The notion of transaction establishes new functions for 
literacy and new goals for the language arts at the very time when most of 
tne profession is involved in discussing nore effective techniques for 
reaching old goals. It calls for basic research on the further 
clarification and identification of successful strzitegies whidi language 
lasers use and teaching techniques whereby learners might experience* see 
demonstrated/ and come to value this aspect of literacy. 

EX?£RI£?iC£ — It identifies strategic behaviors across all language users 
regardless of age and posits experience rather than cognitive stages as the 
key variable in the evolution of literacy. The same language envircximent 
that is good for adults is seen as good for children. Because of the 
pervasiveness of developmental stage theory in terms of the way reading 
researchers and curriculum developers have looked at assessment and 
curriculum/ much rethinking and reconceptualization needs tc be done, 
desperately needed is a revised model of learning which incorporates this 
and other insights into learning. 

CURRICULUM — It suggests that in terms of what the mind doeS/ reading and 
writing share nuch in consicn. Beth are governed by a search for text in 
context/ both are events that occur in time and space/ both are 
socio-psycholinquistic processes/ both are constructive/ both open/ etc. 
Instructionallv/ these insights provide a new perspective on English and 
lead rany tc question mxch of the curricular f ragmen ti^t ion that currently 
exists in the language arts* 

COLLABORATIOJv — Of current interest is not the oDnvention per se, but the 
ccllaborative process b^- which mer<bers of an interpretive comnnunity invent 
and ,?stablish signs and sign functions. The focus cn collaboration is meant 
tc suggest Lhat approaches which attenpt to evaluate a pr :ess curriculum as 
if it were a pro«iact curriculum have failed and led the field astray. 
!;eeded is a focus on the physical and human contexts of literacy and the 
relationships which exist oetween and among strategies in these contexts. 
Tc oe abandoned are current taxonomies of skills whidi assune the goal of 
the language arts curriculum is control of language and its conventions. 

CPSJ — It sug»3ests that literacy is relative/ an cpon potential* dependent 
upcn context of situation. Reading as a strategic form of behavior shculd 
be taught so that students understand that in its specific detail the 
prcoess varies by the circumstances of written language in use. The reading 
currxculam should help students both understand and c*xf>and the heritage and 
varieties of literacies they are qiven. 
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SUNIFInJAIUW — It IS holistic, viewing reading as a nultinodal event and 
one of several systenss of knowing. It stresses that a cpod language arts 
progran expands cxi^jnmunication potential, not just th^ potential to riK^an via 
language, it sees reading as a process of signification having laich to gain 
from interdisciplinary stud/ and application. Alternate nodes of 
comnunication do not corpete but rather offer semiotic potentials to mean 
which vary tyy the circumstances cf language in use and the comnunication 
^sterrs available in these circumstances. 

GEJERATIVE — It highlights the functional nature of literac/ both 
psychologically and sociologically. In so doing it stresses the generative 
nature of reading as a vehicle for personal and social advancement and 
acijustment- Guidelines by which teachers might use the school environment 
to capitalize and facilitate these goals need to be identified. 

It%iArjvJLLAriv>\ — It teaches strategies whereby students can sol'^ problems 
and learn how to leaim using reading as a tool for learning. VJhile reading 
IS seen as an object worthy of study in its own right, it stresses language 
m use and sees learning reading, learning about reading, and learning 
through reading as natural components of every reading event. 

SXiOLOGi' — It stresses the inherently social nature of language and 
language learning. It sees knowledge as socially constituted and calls 
into question psi'chological models of learning which ignore the social 
nature of classrocms and the reading process. 

l:\FJnyJC^ — it stresses the principle that reading t-jachers should be 
people who read with children for £Jurposes of providing demonstrations of 
tne strategies involved in successful written language use and learning. 
Teacheco are enccuraged to use children and themselves as curricular 
infcnrants. 

PkAJTIO^L — it sees research and curriculum development as formal 

e>:?ressicns cf a process model of learning and calls for a collaborative 
ped^qoa^' dedicated to the develo[.ment of practical theory. To be abandoned 
IS the notion that the role of the researchers is to bring theory to an 
essentially atheoretical hc^de. Rather/ future researchers will assume 
tnat from the perspective of the £^rticipants involved a theory cf meaning 
13 m cperaticn and that what is currently being done is, from their 
perspective, adaptive. As a function of this perspective, teadiing and 
researching join hands, change places, and, like reading and writing, come 
to be seen as two names for the sane process. 

LLnSN'Ii^i i^/cIiT — It sees learning as continuous and the function of 
cumojlum as setting up the learning cycle. It suggests that helping 
cnildren value the strategies invcl\-ed in learning how to learn are the 
real strategists of literacy- It soqs reading as a form of logic involving 
arx3jction (things tc ideas), induction (ideas to things), and deduction 

idca^. to ideasN It j^its ano?:alies rather tlian cognitive dissonance as 
Kcy constructs in Learning. Anccalies are seen as transacticns which occur 
ae^ a function of tx^th environmental and cognitive phenomena and include* 
mtuiticii and the search for una'i^^ected harmonies. It sugqests that 
learners are coanitive animalji and that humility and ref lexivity are the 
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hallnar^ts of literacy in process. 

15. POTEtmAL — It sees the past and future of literacy and curriculum as 
potentials rather than as problems. Both are opportunities to debug the 
s^'stem oy engaging in the learning cycle and, in the prccess/ create rather 
than live cut cur future. To fail to rise to the challenge is to fail to 
understand what real literacy/ as it relates both to reading and to 
reasoning/ is all about. 



CONCLUSION'S 



If science proceeds best under the conditions of tension rather than 
acquiescence, then it is an exciting time to be involved in reading. The 
future, like the past, is created, not made. 

The three rajor shifts in assuirptions I have traced in this paper permit me 
to hypothesize that a paradigm shift is occurring in reading. Given ny 
experience with seme researchers and teachers, these shifts — from transfer to 
transaction, from submission to signification, from convention tc collaboration 
— are mere characteristics of some classrooms and programs than of others. 

It IS inportant to understand, however, that these conceptual shifts have 
direct instructional inplications. The entry from the teacher's journal I 
quoted at the beginning of this article allucfes to some of the inplicaticns of 
these chances. ReoDrded in that journal is one sdiool's shift from packaged 
programs to meaningful eraeriences with books, from skill encounters to 
functional reading and writing experiences, and from the role of spectator to 
participant in the literaQ^ learning process for parents, teachers, and 
children. 

There is, then, much that is exciting about the paradigm shift that is 
evolving in the professic«. If Kuhn is right it will become the norm to the 
extent that it solves problems the eld paradign could not solve. Since I began 
fcy describing the characteristics of the new paradigm, it seems appropriate that 
I close with its premises: 

it promises to solve the gap between theory and practice by emphasizing 
collaboration and tne development of practical theory based on language in 
use rather than the iinpcsition of theory on a supposedly atheoretical 
pcpulece. 

2. It invites teachers and children, as well as researchers, to take ownership 
of reading. By cfelining literacy in terms of the mental trips that are 
tal^en, it sees curriculum as a relationship and places curriculum 
development in the hands of teachers. 

i. it prcnses researchers and teachers a now ixirsi^ective cn their kncwing, a 
new cppcrtunity to examine assurrt^ticns, a new q[.fx:rtunity to engage in the 
ioarnmg process thrcugh reading. Truth is not the guarantee of science nor 
the guarantee of the new paradigm: tut rather, science* and the new 
landscape in reading coitprehension, are a potential fcr change. 
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Appendix A 



SHORT FORM 

READir^3 MSTA-A.NALYSIS TAXONOMY AND CODll^ FORM 



REFERENCL: Research to Irrprove Reading Conprehension of Handicapped Students/ 
USOE Funded Research, Indiana University, 1983-85- Co-Principal Investigators: 
Jerome C. Harste, Pamela R. Terry. Project Director: Philip Harris* This form 
developed by Jercn>e Hairste, Diane Stephens, Karin Dahl, Deborah Rcwe, Katherine 
Short, David Heine, Sharon Snyder. 



PART I 

0 In all cases, right justify. 
Identification 



Assigned Nunber for Study 

{to be conpleted at t>i>int of d^ta entry on coirputer) 

Year of Publication 

{enter last 2 digits) 

* 

Kunber of Corpariscns 

(count each Treatment/Control set coded) 

Nunber of Dependent Measures 

{count each subtest as a dependent measure) 



Sccoe Characteristics 



Sanplc Size 

{enter total where !3 = Experimental + Control) 

Sex (l^Ecys: 2=^3irls: 3=Mixed) 

Face 

0 = ::ct specified 

1 = Mincrity 

2 = Mixed 

Inocno 

0 - :%ct Specii^ied 
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1 = All Low (Inner-City: Disadvantaged; Lwer SSS) 

2 = All High (From Private Schools: Higher 3ES: Upper Class) 

3 = All Middle (Middle 5BS: Working Class: Middle Class) 

4 = Mixed (analysis involves norc than 1 group) 

Achievenient Level in Reading 

1 = Poor Readers (if Grade Level minus Reading Level is more 

than 2, or if specified in study) 

2 ~ Good Readers (if readers are on grade level or above, 

or if Grade Level minus Reading Level is less than 2) 

3 = Mixed Group (intact classroom group or 

sanple of good and poor readers) 

Grade Level 

1 = Primary (Grades 1 to 3) 

2 = Intermediate (Grades 4 to 6) 

3 = Junior High (Grades 7 to 9) 

4 = Secondary (Gracfes 10 to 12) 

5 = College (Grades 13 to 13+) 

6 = Adult (not in school) 

7 = Multiage/Grade 



Idantifying Characteristics 

0 - Not Applicable (no label appears in report) 

1 = Mentally Retarded (Mildly or Moderately) 

2 = Learning Disabled 

3 = Enotionally Disordered (Behaviorally Disordered) 

4 = Hearing Inpaired 

5 - ether (e.g. # Severely Mentally Retarded) 

6 = Mixed Special Education Learners 

7 =^ Mixed Regular & Special Learners (Code PLACEMEtIT 0) 

Placement 

J = Net Applicable (no label appears in report) 

1 = Fjainstreamed 

2 ^ Mainstreamed Plus Rescurce Room 

3 - Special Class /School 

4 = Other 



Special Desionaticns 



# Code 0 if 



no specified label appears in report. 



Irrlonontaticn of Treatment 



r-uration (nunbor of weeks) 
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External Validity 

1 = High (Good Test of Treatment) 

2 = Low (Short Duration; Lack Applications) 

Treatirent Personnel 

0 = Not Specified 

1 = Regular Classroait Teacher (No Special Training) 

2 = Regular Special Education Teacher 

3 = Clinician (Learning Disabilities Teacher; 

ReiDedial Reading Teacher; Reading Resource Teacher) 

4 = Experimenter (Researcher) 

5 = Other 

Internal Validity 

1 = High (no nore than one threat to internal validity) 

2 = Low (more than one threat to internal validity) 

Control Group Data 

1 = Included in Study 

2 = Norming Data Used as Control 

(Includes Pretest as Control) 

3 = Treatment Selected as Control 



PART II 



Descriptiai of Treatments 

o Code for each treatment group, 

d Enter a label for the Treatment Group such that another coder may be able 
to identify it when he or she reads the report. If possible, refer to 
tables in report and use label used by researcher, 

• v;hen coding Control, label it as such, 

B To code Descripticn of Treatment, think of reading instruction as 

involving 4 aspects: TEXT, READERS, TASK, and PRPOCESSING STRATEGIES- 
For each aspect manipulated prior to, or as a function of i the treatment^ 
some code must be given- 

• Be sure final coding reflects all characteristics ty which ycu might wish 
to identify treatment and study. 

• LK)GUISTIC umHi MATERIALS, and Ir^STRUCTIONAL PfXTUS should always be coded 
whether or not they have been ranif^lated. 

e Code DOMINAin: FXXTUS of various treatments and control in conjunction with 
each other. To Jetermine DOMINAin* POCUS answer the question/ 'T'Jhich 
aspect reflects the distinction niade in this instructional condition from 
the others?" Code basal instruction -101 • 
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Text 



Consider TEXT as the sum of all print used in a treatment. Code TEXT to 
reflect ireinipulations which have occurred in or across the various texts 
used in the treatment. 



Content 



Structures 



Context 



00 Text Not Focus of Treatment 

01 Quantity (Length) 

02 Density ii of Concepts: # of Propositions) 

03 Repetition of Concepts 

04 Explicitness (Concreteness/ Arrbiguity) 

05 Discourse Type (Expository) 

06 Writer's Intent (Argumsntation, Persuasion) 

07 Syntactic Complexity 

08 Sertantic Repetitiveness 

09 Cohesion (Syntactic Structures Semantic 
Structures/ Referents) 

10 Organizational Structures (Story Structure, 
Global Structure, Story Elements) 

11 Prepositional Structure (Order) 

12 Physical Appearance 

13 Illustrations 



Reader 



Code when treatment is dssigned to affect reader characteristics or when 
READERS have been preselected, screened, or permitted to vary by treatnent 
condition. 



Perspective 
Background 



00 
01 
02 
03 
04 

Psychologica 1 05 
06 
07 
03 
09 

Metalinguistic 10 
Metacoqnitive 11 



Reader Not Focus of Treatment 
Reader Response 

Schena Availability (Knowledge of Content) 

Knowledge of Syntax 

Knowledge of Genre (Text Structure) 

Learning style 

Risk taking 

Attitude 

Interest 

Flexibility 

Apply Old (Process, Strategy) 
Apply New (Process, Strategy) 



Task 
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a Code when the procedures or directions used were a key nanipultation, 

00 Task *^ot Focus of Treatcnent 

Ccnditicns 01 Or<ter (Lesson Frameworks) 

02 Time 

03 Functionality (Sdiool-based vrs non-school based) 

04 Teacher expectation/behavior 
Stance 05 Efferent (Expository Text) 

06 Aesthetic (Narrative/Live-Through Experience) 

Nature 07 Individualized/Indepencfent 

08 Group/Social 

Contexts 09 Situational (Lg School; Program) 

10 Cultural 

11 Linguistic (Cloze/Maze) 
Conditions 12 Perceptual/Motor 
Nature 13 Modality (Contrast) 
Conditions 14 Rate 

15 Regard 



Processing Strategies 

o Code to reflect the level of cognitive activity on which the researcher 
focused. 

00 PS not Focus of Treatment 
Transfer 01 Recall (Supporting Details and Facts, Literal 

Level Questioning: Cn-Line Meaning Maintenance 
Main Idea: Detail) 

02 V?ord Meanings 

03 Identifying text s-ructure (S«-ory Elements, 
Sequence, Referents) 

Interaction 04 Inference (Drawing Conclusions, Interpretative 

Reading Comprehension, Making Generalizations, 
Cause and Effect, Author's Point of View, 
Deduction, Induction) 

05 Sdhena Construction 

Ob Schema Maintenance 

U7 Scheiia Selection (Figurative Language, Fact and 
Opinion, Conparing and Ccffitrasting) 

OS Prediction (Hypothesize, Predicting Outcomes, 
Problem Solving) 

03 Macro-operators (Chunk, Categorize/ Sunrrvarize 
V^ritten Infonration) 
Transaction 10 Transmediation 

11 Abdjcticrj (Analogy, '^letaphcr) 



ERLC 



263 



LANDSCAPES: C0DI^3G FORM 



APPHTOIX A:6 



Linguistic Unit 



01 Ncn-word Units 

02 Words 

03 Clause or Phrase Level 

04 Sentences 

05 Paragraph 

06 Multiple Paragraphs 

07 Text 



Materials 



01 
02 
03 
04 



05 



Instructional Focus 



00 
01 



02 
03 

04 



Domirant Focus of Treatment 



1 = Text + Particular Code (e^gw story structure 
^ ~ was key aspect studied. Code 110.) 

2 - Reader + Particular Code (e.g./ a prereading 
^" activity was key aspect studied. Codo 202.) 

3 = Task + Particular Cude (e.g./ order of reading 
^ related concept materials was key aspect 

studied. Code 301J 

4 = Processing Strategies + Particular Cede (e.g. # 

readers were taught and tested on their 



Learner Made 
Teacher Made 
Researcher Generated 
Coninerically Available by 

Publisher of Reading 

Materials 
Trade/Library 



Instruction not Focus of Study 
Innersion 

(Experience Real 

Process) 
Direct teaching 

Environmental Support (Leading 
from behind: Discovery Lng) 

Material Governed 

(Progranmed Learning) 
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conscious awareness of reading strategies. 
Code 416.) 

5 _ = Linguistic Unit + Particular Code (e.g./ 

word recognition in text was* key aspect 
studied. Code 507.) 

6 = Materials + Particular Code (e.g./ child- 
authored materials was key aspect studied. 
Code 601.) 

7 _ = Instructional Focus + Particular Code (e.g./ 

a free-choice reading program was key aspect 
studied. Code 701.) 



PART III 



Depen den t Measures 

• Code dependent measures which reflect rrajor research questions asked. 

o When less is better/ adjust treatment and control measurements by 
multiplying by a constant. 

e Use labels such that another coder can identify which dependent measure is 
being referred when he or she reads the report. 

o Code MEAN and STAT^DARD DEVIATION OF TREATMENT GROUP/ MEAI^ and STAt4DARD 

DSVIATIC^3 OF CONTROL GROUP/ INTERt^AL CONSISTENCY/ KIND OF f-3SASURE/ TY.^E OF 
i^EASURE/ and UNIT for each dependent measure identified. 



Measurements 



Mean of Treatment Group 

Standard Deviation of Treatment Group 

Mean of Control Group 

Stan<^rd Deviation of Control Group 

Internal Consistency 

1 = High (Match Between What Is Taught & What Is Tested/ 

e.g./ teach inferencing; test inferencing) 

2 - Medium (General Test of What Was Taught/ 

e*.g»/ teach inferencing; test reading achievement) 
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3 = Lew (Marginal Relationship Between What Was Taught 
and What Was Tested/ e.g./ teac±» inferencing; test 
attitude) 



Kind of Measure 

01 = Phonic Test 

02 = Vocabulary Test (Word Reoognition) 

03 = Other Word Analysis Test 

(Includes tests of structural analysis) 

04 = Rate of Reading 

05 = Reading Ccqprehension - Questions 

(Any measure that ascertains oonnprehension 
through questions - multiple choice/ open- 
ended/ true/false ) 
05 = Reading Cooprehension - Cloze 



08 = Reading corrprenensidrr*- 'Retelling 

09 = Conposite Reading Score - Achievement Test 

10 = Oral Reading Grade Level 

11 = Attitude 



13 = Readiness Test 

14 = Spelling 

15 = Other Writing 

(A test of any other aspect of writing skill 
other than spelling) 

16 = Other 

(Any other measure of post treatment perfcrnence. ) 
Type of Measure 

1 = Standfeirdized 

2 =s Not Standfeirdized or Unspecified 



1 




Non-word Units 


2 




Words 


3 




Phrases 


4 




Sentences 


5 




Paragraph 


6 




Multiple Paragraphs (Standardized Tests of 






Reading Ccnprehensicn) 


7 




Text 



Charactertis tics of Me asures 




Self Concept 



Unit 
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HYPOTHESES RESEARCHERS TEST IN THE NAME OF KEADING ODMPREHENSION 



REFERENCE: Research to Improve Reading C^-nprehension of Handicapped 
Students/ USDE Funded Research/ Indiana University/ 1983-85, Co-Principal 
Investigators: Jeroire C, Harste/ Pamela R. Terry, Project Director: Philip 
Harris. This form developed by Jerome Harste/ Deborah Rwe, Diar. Stephens/ 
Sharon Snyder/ Karin Dahly Katherine Short/ Barbara Roberts/ Mark Gabehart/ 
Jean Anne Clyde. 

KE£ 

* = Studies included in meta-analysis 

> = Domirant 
# = NonDominant/ Currently Evolving 
+ = NonDcminant/ Future Directions 

$ = Bridging 



TEXT 



5+10-1. Having children from the start encounter whole/ meaningful texts 
would do laic h to improve reading comprehension . 

(Usually tested when not the dominant focus of the study; Laufer & 
Dvorkin 81; Kleiman 79) 

1 J2. Controlled vocabulary rtaterials/ based either on freguency of word 
use or letter-sound patterns introduced/ would do much to improve 
the te achi ng of reading comprehension. 

(Armstrong 83; Brit ton/ Westbrook & Holdridge 78; Freebody & 
^ Andersen 81; Freebody & Anderson 83; *Kameenui/ Carnine & Freschi 

82; Kicby 79; MarkS/ Doctorow & Witt rock 74; Mason/ Kniseley & 
Kendall 79; Pearson & Studt 75; *Phifer/ McNickle/ Rouning & Glover 
83; Schwantes 82; Shaffer 77; Tamor 81) 



>1 ^» Instructional naterials in which important concepts are repeated and 
highlighted through the use of questions/ structured overviews/ 
etc./ would do nuch to inporve the teaching of reading 
corrprehension. 

(Bates n.d.; Britten, VJestbrook & Holdredge 78; Cachifon n. d.; Cole 
77; Dooling & Lachman 71; *Duchastel 79; *Ellis/ Konoske/ Wulfeck & 
Montague 82; Ellis/ Wulfeck & Montague 80; Fcwler & Lanberg 79; 
Erase, Patrick & Schumer 70; Frase & Schwartz 75; *HayGs Et Readence 
82; *Hiller 74; *Kameenui, Carnine & Freschi 82; *Karahalios/ Tonjcs 
& Towner 79; Kosoff 81; Kuhara & Hatano 80; Lackman 76; *LaPorte & 
Voss 75; *Luiten et al. 80; Mayer 83; Manelis & Yekovich 76; f-lorse 
75; Meek 79; Noakes n.d.; *Peleg & Moore 82: Peterson, Glover & 
Ronning 80; Reynolds & Andersc>^ 82; Reynolds, 5tandiford ^ Anci^rsc^ 
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79; Richmond 76; *Rickards & Denner 79; Rickards & Hatcher 78; 
RicJcards & MoCormidc 77; Rickards/ Anderson & MaCormick 76; 
Rickards/ 76a: Rickards 76b; Rothkoph 72; Royer & Cable 75; Sagaria 
& DiVesta 78; Schumacher/ Moser & Young 83; Sefkow & Meyers 80; 
SKavelson, Berliner, Ravitch & Loeding 74; Sjogren & Timpson 79; 
Vacca 78; Vacca 80; Wiesendanger & Wollenberg 78: *Wilhite 84; 
Wixson 81; Wixson 84) 

^104. Instructional rtaterials in which new concepts are explained 
ccfficretelv would do much to improve the teaching of reading 
corrprehensicxi* 

(Alvoid 83; *Baumann/ Walker & Jdinson 81; Carter 77; Cunningham 76; 
*Dufflemeyer 79; Goetz 79; Johnson 74; Levinson & Carpenter 74; 
Marshall & Clock 78-79; Mayer 83; *Negin & Rics 80; Nicholscxi 79; 
Nicholson & Imlach 81; Olshavsky & Kletzing 79; Pezdek & Rcyer 74; 
Raphael; Myers, Tirrei Fritz & Peadbody 81; Schallert 76; Stupay 77; 
Winklejohan 79; ^Jittrock/ Marks & Doctorow 75) 

^$105. Having children from the start encounter content area naterials^ in 
addition to narrative/ would do much to improve reading 
comprehensio n « 

(Usually tested when it is not the dominant focus of the study; 
Alvenmnn & Boothby n. d. ) 

^106- Instructional naterials which teach children hew the author's 
purpose affects the organization of the text would do much to 
improve reading corrprehension * 

(Bisanz 82; *Cohen & Staver 81) 

107. Instructional materials which are controlled for syntactic 
conrplexity would do much to inprove reading conprehension . 

(Anderson 74; Baldwin 77; Gcwie n.d.; Larsen/ Parker & Trenholme 78; 
Pearson 74-75; Rips/ Smith & Shoben 78; Sdimidt 78) 

108 • Instructional naterials which insure semantic redundancy on 

important concepts would do much to inprove the teaching of reading 
conprehension , 

(Cole, 77; *Rickards 75-76; *Robbins 83) 

>109» Instructional naterials which teach children how to cohesively 
follcvr a chain of ideas through a text would do much to improvo 
reading comorehensicn* 

(Bamitz 80: Beck/ McKecwni Onanson & Pope 84; Chapman 82; *Cohen & 
Stover 81; Coggiola n.d. ;*'DeVillierQ 74; Fishman n.d.; Frt^^body & 
Anderson n.d.: Garrod & Sanford 77; Gacveyi Caramazza & Yates n.d.; 
Gottsdanker-Willekens 01; Gourley 84; *!Jaborlandt & Bingham 76; 
^ HalfC et al. 76; *Irvin 02; Juel 80; *Kameenuii Camine & Freschi 
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111. 
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''"^''•5 ^ '^"^^^'f'^ 74: Lesqold 74; Lindsey 83: 
McGee >il- *A62xn-FranzGn .5 3or<rley n.d.: Marshall & Glcx± 78-79- 

3? "ic^Sf ' iTlZl 2^^'^'"' ^ %cen 

f i JrigJL 83^''"" ''^ ^-^-^-ncxllas 82: ^.est, Stanovich, Feenan 

o^_tne .^o^tj^Oi^6^_^cnto i n^iove reading TOirprehension . 

(Alvenrann 31: *Amold S Brooks 76: Aulls 75; Cirilo & Foss 80- 
Danner 76: Elliott 80: Johnson 70: Kintsch £ YaSough 8? K^haw, 

i?"4l!?' ^ ^^^^^ *Heyer. Brandt slJuS 

NezworsKi, Stem 5 Trabasso 79: ^Raphael/ Mvers Tir>-o r 

Peabody 81: *Ric5cards 75-76: Thc^ndyke ?77tnLL et aT'sI)' 

Ir.3tructional rraterials in v^h jd. id^i. u-.r^ ^^.....^^ 3 
order w ould do nnch ^n In^ v^,^ reading co,Tnr>.h.n!?S^ ^ 

{*Cohen S Stover 31: *Irwin 80) 

instructional naterials which represent the v^nVh,-.. of print and 

Sf ix^ th^^^ ¥-^-^^- ^"^ con_tentW iiliiti4 
look like they cone from conten t area books Ar. n.,^h 

inprove rea ding conprghensi " '-° 

{*Bia2ecJ:, Bialeck c l-lark 77: Bro2o et al. 83; *Carver 75- Coote 
.^ncv 32: Evans, Taylor ^ Blum 77; Fray S. Ko^n ak I^Kintec^T 
r-02mir^ky 77: I^erson 74-75; Mitchell, Bradley & Ai^s 8? Pratt 
%ln^s7f '''' "^"^^ '''' HarsL's'SSanti llT ' 

instructional iraterials which use illustraticn... .r^r-^ effectively to 
^pcrt print wcold do .uch to ,^^rc^•e readinn rr.rJJl:^^^^ 

it^^iSie^^^D^I'^lLv?"''^ " ^^'-^ *^°hen & Stover 

L^. ™'76^tij3J^^^^ 71; *Har.e., 



READER 



+2.31, 



Instructicnal <?uideUne3 for hew teachers Mohh hoip ^^3^^ 
^L^^^-gSrsgec^v^^ xnten>retatinn ..t!?^ 
iTuch to nTT:,rove reaf^ing ccnor ehensicn . — ^ " 

Pict?°^ ShirS^I'.^'ni' ''r^f^^"' ^^"^I'Sa, Schallert 77; Andferscn, 
Piv..er. a, bhirey 8.>: Black, Turner & Bwer 73; Eorko « Bisenhart 84; 
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Canbell '^1: -uliinan* Hcirwoc<i u '^1^ -iiz ?=^hrenreich & Knafle «"^a: 
threnreich c< Knafle liisenhart ^ Bcrko 84: Pass & Sciiuynacker 

81: Galda ^:<2- Zoetzt Re/noIdp# Schallert 4 Radin 83: Grabe T^z Grabe 

Prentice "^j: ^Henderson ^< ^hanker 78: ldo->3a(=stas 60: Kintschi ^ 
3reene n.d.: *Lipscn 33: Mid-iaels S Cazden 84: Pichert 77: Fcihert 
7i: Pichect £t An<3erson 82- He^TiClds/ Taylor# Steffensen/ Shirley S 
Andersen 82: 3teffensenf Joag-Dev & Ander.-icn 79) 

- . Instructicnal ouioelineo for hew teadiers might go about identifying 
and ^Hjjl^Hnq t^ackoround knowledge fear reading a text would do injdi 
to inprove the teaching of reading cofiorohension^ 

(Anderson/ Gpiro, Anderson 7S: Brcwn, Smiley^ Day, Tcwnsend L Lawton 
77: Crafton 83: Clifton 81: Chris topherson, Sd-iultz ^ Waem 81: 
Graves, Brunetti ^ Slater 82: Hare 82: *Holjnes n.d.: Holmes S3: 
Johnston 34: ^rlinzer ?3: Langer S i^Ucoiich 81: *Lipson 82: *iMarr & 
Gcrmley 82: *Pearsonf 'iansen & Gordon 79: Reder & Anderson 80: 
Hibovich 7^: ♦Srith, Readence Alvenran 84: Spiro 80: Stevens 82: 
Sulin Dooling 74) 

r jy . Instructional guidelxnes for helping students use and expand thei v 
kncvr led ge o f s^/ntax, or the flow of lanquace in various print 
settinqSf would de mjch to i np rove reading comp rehension- 

(P^be a »: *Carr 63: :ioff i 82: Day et al. 81: Isakson & Miller 76: 
r:arin3ky/ !larrisoo i^.ell 77: Milier-xTcnes 84: Miller ^ Hosticka 78: 
:Uiagupta 77: Stephen^en, Reynolds/ McClure ^ Guthrie 82) 

>2 )4, Instraccional guidel ines for he lping studants drveloo mental 

expectations for genre — that stories are formatted and oroanized, 
di fferen tly fro r c<ntent area n^terials# far exairple — can do mudi 
t> inyi^rove rea dino contprehensicn . 

[Broun 77: Duffelrreyer ?1: Fagan 84: Grinnell n.d.: Hayes et al. 77: 
lanner, Hiebert I Wincgrad 84: Kintsch 73: McGeo 82a: McGec 82b: 
:!eyerf Brandt & Blutii BO: Kceenthal 79: Taylor 82: Tiemey# Bridge S 
Cera 7 ?: Ulialey i:inograd 83) 

? ^. InstrtiCtic nal gu id elines for helping teacher s natch activities to 
staderi!:s"'^learnxna st^'les wcold dp ru ch to irnprove the te aching of 
reading cciTpr^hensioi. 

(:>crsel 7-»: Hanson 77: Hiobectf Winograd & Oanner 84; Kersner 75: 
^KifTiTiel ^ Mact^initie ^^: Lesic.k 78: Levin, Divine--i!awkins, Kerst ^ 
r^uttnann 7m: Parcarella ^ Pfiauni 31: Pitts S Thonpscxi 82: ^Pitts ^ 
Thcrpson P4: Readenoe f< Palw-^n 78: Rich ^ Push 73: RcbecJc 82: 
Hcborg*^ '* Fli^xor .^4: Taylcc et a1. 7'^) 

♦ if » . Instnictic^ial^ s idelines tcx helping teachecj^ and students 

underst and the*centr^lity of risk-^tak4n3 iri reading^ as wo ll an the 
v.iluo of lo;^rir5k cnvlrcnmcnt when cne is learning to ro^adt wg ild 
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(*McsenthaI A N'a 30) 

Instructional guideUnes for helping students develop positive 
attitudes tward reading would do nuch to inorove reading 
ccnprehension~ 

(Usually tested when not the doinireint focus of the study; Peter 78) 

Instructional guidelines for helping teachera bu ild an 
indiyiAialized readin g program based on student interest would do 
nuch to inprove reading conprehension. 

(Asher/ Hymel S Wigfield 78: Asher 79; Newnan 77; Stevens 80; 
Suimers & Lakasevich 83; *S2aba & Laneill-Landy 81; Walker/ Koland & 
Greenshields 79) 

i20^. iTTstructic nal guidelines for helping students understand and 

flexibly apply a variety of reading strategies when they encounter 
sonething unknown in print would do much to inprove reading 
cotrprehensicji . 

(Dwdy et al. 32: *Finch 82; r^yer & Rice 83; ffevell £ Hoffnan 81; 
Olshavsky 78: Spiro & Tirre 80) 

Instructional guidelines for helping students apply the strategies 
they alr eady have to new settings would do nuch to inprove a child's 
reading cc-.-rprehension. 

(Anderson 76; Atwell 82; Baker & Anderson 82; Bos & Filip 84; Brooks 
et al. 77: Brown S Day 83; Brown, Day & Jones 83; Brown & Sndley 78; 
Brown et al. 83: Cauley s Murray 82; Clark 82; D'Angelo 81; Ewoldt 
81: Fitzgerald 82: *Gamer 81; Gamer 82; Gamer S Alexander 82; 
Gamer s Reis 81: Gamer & Tyalor 82; Gamer/ Wagoner & Smith 83; 
Grinnell 82; Rare 81; Hiebert 81; Kavale 80; Kavalfe & Schreiner 79; 
Kendall S Hood 73; & MacGinitie 84; Laffey S Huia n.d.; 

XacGinitie S KacGinitie 84; Mascnheimer et al. 84; KoGee 82; Keyer 
et al. 80: Ks/er & Rice 83: «eyers & Paris 78; Kceenthal 79; 
Mosenthal S Davidson-Xosenthal 82; Nilagupta 77; Olshavsky 76; 
*Pirc«3ruen & Boonprasert 83; Pitts et al. S3; Sulzbv 78; Taylor & 
Williams 83; Tenny 75: Winograd 33a; ■*l^inograd 83b;"winograd & 
Johnston 82; Wong & Jones 82) 

>211. Instructic oal^jjelines for helping students develop new reading 
strategies (str ategies vhidh they do not al ready possess such as 
self-correcting and self-{xnitor in grwould~3o imch to inprove — 
reading conprehension. ~ 

(*A<ferr5/ Gamine S Gersten 82; *Bamett S4; Bates 83; *Carr 83: 
Calfee 5 Piontcwski 81: Gamine 77; Glark/ Deshler/ Schunaker/ Alley 
& Warner 84: Cohen 83: *Ellis, Knoske & Kulfeck 82; *Finch 82; Frase 
& Sce.wartz 75: *Ge\'a 83: Grabe fi Mann 84; Gamer 82; Gamer & Rare 
84: ♦Grawr, Coc*:e & Laberge 83: Haywardi Orlando & Blicsner 77; 
Jongsma/ Pound & Tips 7f»; ^ing et al. 84: Klein & Schwartz 79; 
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Lox'elaoe s MdCnight 80: Kcrse 76: racholson 84: Smith & Standal 81: 
*Taylcr ^ Beadhi 84: Winograd et al. 84: vfcng & Jones 82) 



^301. Developing structured lesscxi frarnes whidi teachers naght use to 
guide their in teractions with stucfents before, during^ and after 
reading, would do much to inprove the teaching of reading 
coiiprehension , 

(*A(3ms, Gamine & Gerstein 82: *Alaxander et al, 84; Anderson 76; 
Aulls Sl Gelbart 80: Eean & Pardi 79: Biskin/ Hoskisscn & Modlin 76: 
Blandiard 81: Colwell 82: Carver & Hof fnan 81: *Cunninghain 83; 
Hansen, Schreiner Sc Hunmel 77: Laff^ & Kelly n^d.: *Langer 84: 
Lindsey 80: *Malcoltn, Albertini, Burke & Kunphrey 80: Miller/ 
HcKenna & Kear 82: O'Shea & Sinelar n.d-: Pauls & Garrett 84: Petre 
76: Pflaum & Bryan n.d.: Sachs 83: Salomon & Adienbach 74: Schunaker 
& Deshler 82: Stetson 81: *White, Pascarella & Pflaum 81: Wolf 78: 
Wixscn 84: *Wixson, Yochum & Eosky 84: Yesseldyke et al, 84) 

3^2. Procedures which help teachers understand time on task and its 
relationship to student learning would do nuch to iirorove the 
teaching of reading comprehension, 

{Allington, 80; *Becker 77; *Fleischer & Jenkins 83: Gairbrell, 
Wilson fir Gantt 81;*vulhavy & Swenscn 75; *Hayes & Tiemey 82; 
rruinnarai & Brady 74; Yasseldyke & Alghozzine 83) 

Understanding how the rules of language use change across reading 
contexts so that the varices uses of reading in classroong relate 
nore realistically and functionally to readirig outside the classroom 
wojild inprove the teaching of reading conprehension , 

(Usually tested when not dominant focus of the study: *E11^ & 
Wangubhai 83) 

Procedures whidt help teachers understand how their expectations, 
beliefs, and instructional strategies affect stud&nt expectations , 
beliefs, and reading behaviors would do much to inprove reading 
coiTprehensicn , 

(Allington 80: Allington 84: Blaine & ArgumeA> 84: Bcrko 82; *Duell 
74; Pumiss & Graves 80; Gall, Kard/ Berliner, Cahen, Wime, 
Elashott li Stanton 78: Kibby 79; ^Luftig 83; *Kchr et al. 84: ^^oore 
& Cunninghani 83; Pehrssco 74) 

^5305. Procediires whidi help teadiers more effectively use texts in content 
are^ teacjiing do much to inprove reading conprehension . 

^ {Usually tested when it is not the dominant focus of the study) 
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?#3''^''. Procedice s which hel p tea diers facilitate the rea(3er's aesthetic 
response, t o text — that is, hava children experience and value 
reading as a li\-ed-thro>jqh experience — wc«ld do nuch to inpro ve 
reading comprehension . ' ' 

(L'sually tested when it is not the dominant focus of the study; 
Dixon & von Eye 84) 

Procedures which help teachers individualize instruction, thus 
permitting children to work rore independently in reading, would d o 
nuch to inprove reading conprehensicn . " — 

(*AarDn S. Muench 74: Cox & Wilson 81; Reinking & Sdireiner 84; 
Sindelar S2a: *Sin^lar 82b: Patching, Kameenui, Gamine, Gersten fi 
Colvin 83) 

5+5^^. ProceA^rgs which help teachers capitalize on the social reture of 
classrooms and language , and which pronote collaboration and peer 
suEgprt for r eading, wot. Id do nuch to inprove reading conorehension. 

(Usually tested when not dDininant focus of the study; Mcsenthal 83) 

* - - Procedures for helping teachers orchestrate and understand how 

M£g£g^^lg3gj-Igctors, includin g those above and bevCTid the classroom 

^yPgct on teaching^ andj eaming would do much to inprove 

readi n g ccMiprehension. ~ 

(Allington 80: Au & Mason 81; Au 80; Blocne 5 Arguendo n.d.; Calfee 
& Picntkowski 81; *Comelius & Semnel 82; Durkin 79; Durkin 83; 
Kurth & Greenlaw 84; Lemhardt, Zignond S Cooley 81; Lovitt fi DeMier 
34: Mason 83; Kcsenthal 83; Neilsen, Rennie & Connell n.d.; Pierce 
34: Singer et al. 84; Smith 83; Smith & Feathrs 82; Stauffer fi 
Hairncnd 76: Stauffer n.d.; Stauffer n.d.; Stock&le & Crunp 81; 
*Taylor 84: Tharp 82: Vacca 80) 

Procedjres which help t eachers build a reading program which 
HgSfggg ^.^ nakes oonnecticn with the jjltural strengths and 
tackground s of students would do mtch to inprove reading 
conprehensicn . 

{Usually tested when it is net the dominant focus of the study; 
*Cohen S Rodri^quez 80; *Lipscn 83: *White 79) 

m. Procedjr es which hel n teachers design cloze and naze activities for 
the instructional purccs es-of highlighting and facilitating reader's 
gttentico to particula r linguistic features in text would do nuch t o 
inpr ove reading conprehensicn . 

{Dixon & vcn Eye 84; *Ehri S Wilce 80; *Irwin 80; *Schwartz 80; 
Smith-Burke et al. 78; *Straw & Schreiner 82; Zinck 78) 

PcoceAares for helping teachers understand and exploit th e 
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relationship between reading conprehension activities and 
perceptual,4K>tor training exercises would do much to inprove reading 
conprehens ion . 

(Criffin/ Walton & Ives 74: Lindsey 83: Punnet t & Steinhauer 84: 
Riley S Lowe n.d,: Sailor & Ball 75: Swanson 83: Swanson 84) 

\^^' Kncvinq how nodblity — oral/ visual/ kinesthietic — might be nore 

effectively used to facilitate learning would do nuch to inprove the 
teaching of reading ccnprehensioi ^ 

(Berger 78: Buroe 83: Code & V7elch 80: Deader 75: Dubey & O'leary 
75: Eagan 75: Juel & Holrnes n.d.: Marlowe, Sgner & Foreiran 79: 
McCcnaughy 82: Miller & Smith 84: Rowell 75: Smiley/ Oakey Worthen/ 
Chapicne & Brown 79: Snow/ Coots & Smith 82: Vfeilker 75-76: Wfeisberg 
79; Wiesendanger i Birlem 81: Wisenan/ Hartwell & Hannifin 80) 

? 14 . Procedures which help students understand that reading rate should 
vary with the purpose for reading would inprove reading 
conprehension. 

{Coclin et al. 84: Collins 79: Perfetti & Goldman 76: Samuels- Begy 
S Chen n*d. ) 

SI""', Procedures for helping teachers understand and exploit the 

relationship between intrinsic and extrinsic re^^ards and student 
reading be h avior would do rmch to improve reading comorehension, 

(JeakinSf Bazksd^le & Clinton 73: Lovitt & Hansen 76: Rc^rts & 
Snith 80: Swanson 81) 



PROCESSING STOATEGIE^ 



>S401. Strategies whi<A help studsnts recall factS/ monitor cn-line 

meaningi and identify frain ideasy would do nuch to improve reading 
CQgrprehension. 

(Beebe n,d,: Blachcwicz 78: Britten n.d.: Bridge/ Belmore/ Moskow, 
Brittoi/ Keyer/ Sinpsco/ Cchen & y^atthews 84: Dixon & von Eye 84: 
Dubbs 79: Gagne & Memory 78: Golinkcff St Rcsinki 78: Gottesrran et 
al* 82: Hansen 73: Isakson 79: Kagan 83: Levy 77: Karzano et al. 76: 
Cransco, Bedc* Vcss ^ McKecwrj 84: Perfetti St Hogaboam 75; Jtelson & 
Geyer n.d.: *Pearscn/ Hansen & Gordon 79: Perfetti & Goldrran 76; 
Pflaum & Pryc-n n,d*: Reid & Hresko 80: *Rickan3s 78: ^Wixon/ Ycchum 
^ Bosky 84} 

* 4C2 . Strategies which help gtu&nts learn new vocabulary worcte and 
inprove word identification would do nuch to imprpve reading 
caiT>rehem;icn. ' 
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C*AbranDvici 84: Andersen, Pichert/ Goetz/ Schallert/ Stevens & 
Trollip n,d-: Anderson, Stevens, Shrifrin & Osbom 78: *Amold/ 
MdJinch Miller 78; Balasa 74; *Beck, Perfetti £r Mdxeom 82; 

*Canney & Schreiner 76-77; *Camine, Kameenui & Coyle 84; *Cartelii 
77: *Chabct, Zehr, Prinzo S Petrosky 84; Cleary n-d.; *Cunningham & 
Cunningham 78; Gipe 78-79: Hatch et al. 74; Jackson 79; Jacoby, 
Craik & Begg 79: Jenkins, Larson & Fleisher 83: *Kameenui/ Gamine & 
Freschi 32; *Kat2 & Singer 32: Kanul & Hanson 78; McKeown, Beck, 
Oranson & Perfetti 83; *KeiTtko 84; *Panny & Jenkins 78; *Pany/ 
Jenkins & Schreck 82; *Rash, Jcrfinsoo & Gleadow 84; Roser & Juel 82; 
♦SaiTcels, Dahl S Archwarety 74; *Stahl 83; Stanovich, Cunningham & 
Feenan (in press); *Till, Comak & Prince 77; Vauc^n, Castle, 
Gilbert Love 82) 

*34C 3. Strategies whiA help students identify inportant eleinents in texts 
suc h as ploty sequence, and storv line would do much to irorove 
reading conprehensioi . 

(Related to 201; Baunran 83: Coggiola n.d.; Eanon 79; *Geva 83; ^atz 
Sic Singer 32: *Sairpson/ Valnont & Van Allen 82; Sebasta, Calder & 
Cleland 82; Staadt & Balbo 79: ^Weaver 79; t^aver & Dickinson 82) 

>404. Strategies which help students draw ccHiclusions, nake 

gen e ra 1 i zations, and in general inprove their inferencing abilities . 
would do rrudi to iirprove reading conprehension ^ 

(*8aurrann 84; *Beebe ^ Malicky 82; Bcs & Tiemey 84; Brockway/ 
Chmielewski & Ccfer 74; Burton/ Niles & Wildiran 81; Carpenter & 
Jones 75; *Carr, Dewitz & Patberg 83; *Chodos, Gould & Rusch 77; 
Corbet t & Dcsher 78; *Cunningham 83; Dixon ^ von Eye 84; Frederiks^ 
75; *Gamer & Alexander 31: Galda 82; Gamer 81; Garrod & Sanford 
77; Goetz 79: ^Gordcrn 80: *Gordon & Braun 82; Greenlaw & Mcintosh 
84: llaggard 78: Hansen 31; Lipson 82; ^Patching, Kameenui, Gamine/ 
Gersten & Colvin 83; Raphael McKinney 83; Singer 79; Singer 80; 
Stdhl 63: *Till, Ccntak & Prince 77; Wilson & Hammill 82: *Winograd 
Sr Jchnston 82; *Wixcn/ Yochurn & Bosky 84) 

^54^"^- Stgt^egi^s whldh help students mentally^ construct schena or naps of 
how new c o ncepts and ideas interrelate in the text they are reading 
would do nuc h to iirprove reading conprehension ^ 

{Usiially tested when it is not the dominant focus of the study: 
*Carr, Dwit:: & Patberq B3: Kealey 82: Spire n.d,: *Singer & Dcnlan 

82) 

4 06 . Strategies whi dri help student s maintain reading skills through 
application to n ew select i ons would do tnuctt to iTtorove reach ing 
cocTprehe nsion^ 

(Gagne & Menory 7y; :«5arr 7i: Shoben/ Kesocurt & Smith 78: Smith/ 
Adims & Schorr 78) 

^ +407 • Strategies which help s tudents re ad critically fcr purposes of 
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distinguishing fact from opinion/ cxHrparing and contrasting/ and 
interpreting figurative language, would do mudi to inorove the 
teaching of reading conprehension , 

{*Alvermann 83; *Winograd & Johnston 82) 

>$408. Strategies which help students more actively engage in text 

rredi ction and hypothesis testing would do rxich to improve reading 
conprehensio n . 

{Usually tested when it is not the dondrjant focus of the study; 
Related to 406; Gagne & Menory 78; Kavale a Schreiner 79; Parker & 
Putnam 84) 

^40^. Strategies which help students suimarize by coherently reducing and 
organizing what they have read would do nuch to inprove reading 
conp rehen sion. 

(Bates 83: *Bean, Singer, Sorter & Frazee 83; *ChodDS, Gould & Rusoh 
77; Cunningham 82; Eanet 78; *Gordon & Braun 82; *Hare & Smith 82; 

*Meyer, Brandt & Bluth 80; Stein & Glenn 78; *Taylor 82; Willians & 
Taylor 83; Williams 84; *Winograd 84) 

^^410. Strategies which encourage students to recast meanings gained 

through reading in alternate oommunication systems such as writing, 
art, mathematics, nusic, etc. , would do nuch to inprove the teaching 
of reading conprehension. 

(Cramer 80; *Findi 82; Gagne & Menory 78; Galda 82; *Ganbrell 82; 
Hayes & Readenoe 82; Koskinen & Cole 81; *Les9Dld, HoCormick & 
GoliiJcoff 75; *Linden & wittrodc 81; *Pressley 76; Sheldon 84; 
Siegel 84; Steingart & Glock 79; *Sadoski 83; *Sadoski 84) 

Methods and naterials which encourage students to make connections , 
via metaphor and ana logy i between their past experiences and what 
^hey already know, would do mudi to further their independent 
coistructicn of new knowledge and to inprove reading conprehension, 

(Billow 75; Douglas & Peel 79; Gagne & Menory 78; Galda 82; Gick & 
Holyoak 80; Haggard 76; Hayes & Henk 84; Hayes & Tiemey 82; 

^ulhavy & Swenson 75; Levinscn & Carpenter 74; *Linden & Wittrock 
81: *Tili, Cornak Prince 77; WosniadDu & Ortony 84; Winner/ 
Rosenstiel & Gardner 76; *Yeazell 82) 
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